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(54) System for generating interactive software applications 



(57) An interactive applications generator is utilized 
to generate an interactive application for use on a single 
server multi-client network computer system. The inter- 
active applications generator permits a user to define a 
graphical user interface (GUI), that contains one or more 
display screens, for a customized interactive applica- 
tion. The interactive applications generator contains a 
screen template editor (210), a media frame editor (230), 
a screen editor (220), and an interactive presentation 
editor (200). The screen template editor (210) is utilized 
to create generic screen templates, that contain generic 
screen template elements. The media frame editor (230) 
is utilized to generate media frames by combining mul- 
timedia component elements in a time synchronized 
manner. The screen editor (220) is utilized to generate 
the display screens including assigning functionality In 
order to create a unique instance for each display screen 
for a particular interactive application, the screen editor 
(220) references generic screen templates and media 
frames. The interactive presentation editor (200) is uti- 

t" lized to create the hierarchical structures that defines 

^ presentation of the display screens for the particular in- 

^* teractive presentation. 
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Description 

This invention relates to the generation of interactive 
applications for use. for example, in an interactive pres- 
entation environment. 

In general, interactive applications software is de- 
veloped for use in an interactive applications environ- 
ment. Typically : interactive applications software in- 
volves the manipulation of media and the presentation 
of a graphical user interface. The interactive applications 
environment permits a user to select various media ele- 
ments via the graphical user interface. For example, in 
a cable television interactive system, the customer may 
be presented with a user interface consisting of one or 
more menu screens. The menu screens permit the user 
to select various media elements, such as movies, music 
videos and the television programming. Preferably, the 
menu screens are customized for a particular audience. 
In addition, it is desirable to update the menu screens 
over a period of time. Upon entering a selection via the 
user interface menu screen, the user is presented with 
the appropriate media element. It is necessary to update 
the available media elements as new media elements 
become available. 

The creation, modification, and maintenance of in- 
teractive applications software is difficult and time con- 
suming. For example, each application for the interactive 
application software involves development of a unique 
user interface so that each customer receives a custom- 
ized product having a unique look and feel. Therefore, 
for each application, the developer of the interactive ap- 
plications software must specialize each display screen 
in the graphical user interface for each customer. Con- 
sequently, it is desirable to develop tools to facilitate in 
the development of customized display screens for a 
user interface. Furthermore, the presentation of menu 
screens to create the user interface is dependent upon 
the particular application. Therefore, for each applica- 
tion, the developer of the interactive applications soft- 
ware must specialize the software to accommodate the 
appropriate presentation of menu screens. Consequent- 
ly, it is desirable to develop tools to facilitate in the de- 
velopment of the presentation of screens to create cus- 
tomized interactive applications environments. 

In addition to the development of interactive appli- 
cations software, the maintenance and updating of inter- 
active applications software is typically difficult. For ex- 
ample, in any interactive applications environment, as 
new media elements become available, the interactive 
applications software requires updating to accommo- 
date selection and access to the new media elements 
In addition, it is desirable to update the customized user 
interface without the need to update each individual dis- 
play screen used by an interactive application program 
Consequently, it is desirable to separate the user inter- 
face portion of multimedia display screens from the in- 
teractive media portion. As will be described, a preferred 
form of implementation of the invention set out in detail 



124 A1 




below provides a method and apparatus for an interac- 
tive applications generator to develop and maintain in- 
teractive applications software for use in an interactive 
presentation environment. 
5 Respective aspects of the invention are set out in 

claims 1 and 35 hereof. 

The preferred form of implementation of the inven- 
tion set out in detail below provides: 

an interactive applications software generation tool 
10 that minimizes the cost and difficulty in creating large 
amounts of custom interactive software involving media: 
the ability to decouple the user interface portion of 
multimedia display screens from the interactive media 
portion: 

'5 the ability to permit generation of customized look 

and feel user interfaces while maintaining a generic base 
of interactive media; _ 

the ability to permit updating "of the customized 
user interface without the need to update each individual 

20 display screen used by an interactive application pro- 
gram: 

the ability to provide an automated method to in- 
terconnect display screens into interactive application 
programs utilizing a drag and drop operation: and 

25 the ability to utilize interactive application object li- 

braries to insert functionality into the interactive applica- 
tions generator. 

The preferred form of implementation of the inven- 
tion comprises an arrangement that includes an interac- 

30 tive applications generator that generates interactive ap- 
plication programs for operation in an interactive appli- 
cation environment. In a preferred embodiment, the in- 
teractive application environment is implemented on a 
single server multi-client network computer system. The 

35 application programs permit users, accessing the single 
server multi-client network, to interact with multimedia 
presentations. The single server multi-client network 
computer system includes a graphical user interface 
(GUI) that defines the interactive application environ- 

io ment. In general, the interactive application environment 
permits a user to access selective multimedia presenta- 
tions. The interactive application environment contains 
one or more display screens. In general, the display 
screens are either menu screens or application screens. 

15 The menu screens permit selection^ additional menu 
screens or application screens, and the application 
screens constitute a GUI for a particular application pro- 
gram. 

The GUI look and feel of the multi-client network 
so computer system, including the presentation of display 
screens, is generated by the interactive applications. 
The interactive applications generator may be executed 
on any computer system equipped to handle multi-media 
applications. In order to generate a customized interac- 
ts tive application environment for a particular application, 
the interactive applications generator contains a screen 
template editor, a media frame editor, a screen editor, 
and an interactive presentation editor. The screen lem- 
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plate editor is utilized tocreate generic screen templates, 
that contain a plurality of generic screen template ele- 
ments. The media frame editor is utilized to generate me- 
dia frames by combining multimedia component ele- 
ments in a time synchronized manner. The screen editor 
is utilized to generate the display screens including as- 
signing functionality. In order to create a unique instance 
for each display screen for a particular interactive appli- 
cations environment, the screen editor references ge- 
neric screen templates and media frames. The interac- 
tive presentation editor is utilized to create the hierarchi- 
cal structures the defines presentation of the display 
screens for the particular interactive presentation envi- 
ronment. 

The screen template editor contains a screen tem- 
plate editor graphical user interface (GUI) that displays 
a plurality of tool dialog boxes on an output display to 
permit a user to select the generic screen template ele- 
ments. The screen template editor GUI also contains a 
screen template build window for designing the screen 
template. The tool dialog boxes include a logos dialog 
box, a backgrounds and borders dialog box, controls di- 
alog box and a media frame window dialog box. The con- 
trols dialog box permits selection of buttons, sliders and 
indicators. The borders dialog box, the logos dialog box. 
and the media frame windows dialog box contain a list 
box, for providing option's to define a graphical look of 
the screen template, and a thumbnail sketch window for 
displaying a corresponding highlighted selection in the 
list box. In addition, a select button permits a user to se- 
lect the corresponding highlighted selection in the list 
box. The borders dialog box permits a user to specify 
background color, background texture, border color, bor- 
der style, drop boxes and lines, and the logos dialog box 
permit a user to select from a number of available logos. 
The media frame windows dialog box permits a user to 
select a media frame window location within the generic 
screen template, such that a dotted border comprising 
size and aspect ratio of said media frame selected is dis- 
played in the screen template build window. 

The media frame editor permits a user to generate 
media frames comprising images, graphics, animations, 
video clips, text, and sound clips. The media frame editor 
includes a media frame editor graphical user interface 
(GUI) that displays a timeline window consisting of media 
tracks, a time scale and a vertical cursor. The media 
frame editor GUI contains a media selection window, in- 
cluding a list box and buttons, to permit a user to attach 
media frames to a media track. The media selection win- 
dow further includes a thumbnail sketch window for dis- 
playing viewable media elements selected via the list 
box. A run window, contained within the media frame ed- 
itor GUI, permits a user to view selected media frames. 
In order to run selected media frames, breakpoints are 
set so that the run window displays successive media 
frames on a selected media track between adjacent 
breakpoints. The media frame editor GUI also contains 
time line transition special effect functions including a 



cut. fade in. fade out. dissolve, horizontal wipe, vertical 
wipe, and digital wipe. Furthermore, the media frame ed- 
itor GUI includes pan. zoom and complex pan and zoom 
functions to generate media frames that incorporates 
5 panning and zooming of a media element. 

The screen editor contains a screen editor graphical 
user interface (GUI) that displays a screen layout includ- 
ing a graphical representation of the generic screen tem- 
plate referenced. In addition to the borders and logos, 

to the generic screen template includes outlines of media 
frame windows and controls. The screen editor GUI con- 
tains a media frame catalogue comprising a separate 
window and that permits a user to scroll through a cata- 
logue of media frames. Utilizing the media frame cata- 

'5 iogue : the user assigns, via a drag and drop operation, 
a media frame to a media frame area on the screen lay- 
out. A function library catalog contains a separate win- 
dow that permits a user to scroll through a library of pre- 
defined functions. The function library catalog is also a 

20 drag and drop operation that permits the user to assign 
functionality to a control on the screen layout. 

The interactive presentation editor contains an inter- 
active presentation editor graphical user interface (GUI) 
that displays screen identifier icons on an output display. 

25 The screen identifiers correspond to a the display 
screens, and the interactive presentation editor GUI per- 
mits a user to place the screen identifiers in a hierarchical 
structure. The interactive presentation editor GUI in- 
cludes a screen catalog to permit a user to scroll through 

30 a library of display screens. The screen catalog contains 
windows and controls to permit selection of a display 
screen for placement in the interactive applications en- 
vironment. 

The interactive presentation editor GUI contains di- 
ss alog boxes corresponding to each display screen that al- 
lows a user to enter specific display screen information 
such as a text description, a screen identifier to link a 
display screen to a media frame and a screen template, 
a list of each control on the display screen, and a link to 
-to either an application screen or menu screen. In addition, 
grouping information, to classify display screens in a 
group level, may be entered. In order to create a hierar- 
chical structure of display screens, drag and drop menu 
screen and application screen operations are provided 
-*5 to place a corresponding screen identifier, representing 
a display screen selected, in any level of the hierarchical 
structure. If a child display screen is dropped within a 
parent display screen, then a forward link from the parent 
menu screen to the child display screen is created. Al- 
so ternatively. a forward link command is provided to estab- 
lish a link from a control in a parent menu screen to a 
child display screen. In addition, the interactive presen- 
tation editor GUI contains a back path command to es- 
tablish link from a child display screen to exit to a screen 
55 other than a parent display screen. 

The invention will now be further described, by way 
of illustrative and non-limiting example, with reference to 
the accompanying drawings, in which; 
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Figure 1 illustrates a computer system for generat- 
ing a window-based graphic user interface in accord- 
ance with an embodiment of the invention. 

Figure 2 illustrates a program hierarchy for an inter- 
active applications generator embodying the invention. s 

Figure 3 illustrates a graphical user interlace for an 
interactive presentation editor. 

Figure 4a illustrates a file menu for the interactive 
presentation editor. 

Figure 4b illustrates an edit menu for the interactive 10 
presentation editor program. 

Figure 4c illustrates a view menu for the interactive 
presentation editor. 

Figure 4d illustrates an operations menu for the in- 
teractive media presentation editor. 15 

Figure 4e illustrates a tools menu for the interactive 
presentation editor program. 

Figure 4f illustrates a help menu for the interactive 
presentation editor program. 

Figure 5 illustrates a screen identifier movement op- 20 
eration via the interactive presentation editor. 

Figure 6 illustrates the interactive presentation edi- 
tor graphical user interlace. 

Figures 7a-b illustrate an example of an expand 
command configured in accordance with the interactive 25 
presentation editor. 

Figures 8a-b illustrate a reduce command for an ex- 
ample screen hierarchy. 

Figures 9a-b illustrate an example of a tree subset 
function. 30 

Figure 1 0 illustrates an example of the functionality 
of the menu screen command. 

Figures 11a-11b illustrate the operation of adding 
an application screen to a screen hierarchical structure, 

Figure 1 2a illustrates the creation of a forward link 3S 
via the forward path command for an example screen 
hierarchical structure. 

Figure 12b illustrates the menu hierarchical struc- 
ture after creation of the forward link between the ICS 
main menu screen and the information services menu -to 
screen. 

Figures 13a-b illustrate an example of a screen hi- 
erarchy structure for the operation of the back path com- 
mand. 

Figure 14 illustrates an example of a screen hier- -is 
archical structure during the design check process. 

Figures 15a-b illustrate an example screen hierar- 
chy structure for the operation of the regeneration com- 
mand. 

Figure 1 6 illustrates a GUI for the screen editor. so 
Figure 17 a illustrates a file menu for the screen ed- 
itor. 

Figure 17b illustrates an edit menu for the screen 
editor program. 

Figure 1 7c illustrates a view menu for the screen ed- ss 
itor program. 

Figure 17d illustrates a tools menu for the screen 
editor 
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Figure 1 7e illustrates a help menu for the screen ed- 
itor program. 

Figure 18 illustrates an example of a media frame 
catalog. 

Figure 19 illustrates an example of a function library 
catalog window. 

Figure 20 illustrates a graphical user interface for the 
screen template editor. 

Figure 21a illustrates a controls tool dialog box. 

Figure 21 b illustrates a logos tool dialog box. 

Figure 21c illustrates a backgrounds and borders 
tool dialog box. 

Figure 21 d illustrates a media frame windows tool 
dialog box. 

Figures 22a-d illustrate a graphical user interface for 
the media frame editor. 

Figure 23a illustrates a file menu for the media frame 
editor. 

Figure 23b illustrates an edit menu for the media 
frame editor. 

Figure 23c illustrates a view menu for the media 
frame editor. 

Figure 23d illustrates an operations menu for the 
media frame editor. 

Figure 23e illustrates a tools menu for the media 
frame editor. 

Figure 23f illustrates a help menu for the media 
frame editor. 

Figures 24a-n illustrate the media frame track edit 
syntax. 

Figure 25 illustrates a pan display effect for the me- 
dia frame. 

Figure 26 illustrates a zoom display effect for the me- 
dia frame. 

Figure 27 illustrates a first complex pan and zoom 
effect for the media frame editor. 

Figure 28 illustrates a second complex pan and 
zoom effect for the media frame editor. 

Figures 29a-f illustrate a target application media 
frame format. 

Figure 30 illustrates a generalized output format for 
the interactive applications generator. 

Figures 31a-b illustrate one implementation, in 
Booch notation, for the interactive^applications genera- 
tor. 

NOTATION AND NOMENCLATURE 

The detailed descriptions which follow are present- 
ed largely in terms of display images, algorithms, and 
symbolic representations of operations of data bits within 
a computer memory. These algorithmic descriptions and 
representations are the means used by those skilled in 
the data processing arts to most effectively convey the 
substance of their work to others skilled in the art. 

An algorithm is here, and generally, conceived to be 
a self consistent sequence of steps leading to a desired 
result These steps are those requiring physical manip- 
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ulations of physical quantities. Usually, though not nec- 
essarily, these quantities take the form of electrical or 
magnetic signals capable of being stored, transferred, 
combined, compared, and otherwise manipulated. It 
proves convenient at times, principally for reasons of 
common usage, to refer to these signals as bits, values, 
elements, symbols, characters, images, terms, num- 
bers, or the like. It should be borne in mind, however, 
that all of these and similar terms are to be associated 
with the appropriate physical quantities and are merely 
convenient labels applied to these quantities. 

In the present case, the operations are machine op- 
erations performed in conjunction with a human opera- 
tor. Useful machines for performing the operations set 
out below include general purpose digital computers or 
other similar devices. In all cases, there should be borne 
in mind the distinction between the method operations 
of operating a computer and the method of computation 
itself. The present disclosure relates to method steps for 
operating a computer and processing electrical or other 
physical signals to generate other desired physical sig- 
nals. 

The present disclosure also relates to apparatus for 
performing these operations. This apparatus may be 
specially constructed for the required purposes, or it may 
comprise a general purpose computer selectively acti- 
vated or reconfigured by a computer program stored in 
the computer. The algorithms, methods and apparatus 
presented herein are not inherently related to any partic- 
ular computer. In particular, various general purpose ma- 
chines may be used with programs in accordance with 
the teachings herein, or it may prove more convenient to 
construct more specialized apparatus to perform the re- 
quired method steps. The required structure for a variety 
of these machines will appear from the description given 
below. Machines which may perform the functions of the 
present invention include those manufactured by Sony 
Trans Com. as well as other manufacturers of computer 
systems. 

DETAILED DESCRIPTION 

The present description discloses apparatus and 
methods for an interactive applications generator. In the 
following description, numerous specific details are set 
forth such as computer system configurations, window 
elements, icons, desktop sizes, metaphors, window con- 
figurations and arrangements, etc. in order to provide a 
thorough understanding of the present invention. How- 
ever, it will be apparent to one skilled in the art that the 
present invention may be practiced without these specif- 
ic details. In other instances, well known circuits, struc- 
tures and the like are not described in detail so as not to 
obscure the present invention unnecessarily. 

Referring to Figure 1 . the hardware configuration of 
the apparatus is conceptually illustrated. Figure 1 illus- 
trates a computer system for generating a window-based 
graphic user interface embodying the teachings of the 



present invention. As illustrated, the computer system in- 
cludes a computer 20 which comprises four major com- 
ponents. The first of these is an input/output (I/O) circuit 
22, which is used to communicate information in appro- 
s priately structured form to and from other portions of the 
computer 20. In addition, computer 20 includes a central 
processing unit (CPU) 24 coupled to the I/O circuit 22 
and to a memory 26. These elements are those typically 
found in most computers and. in fact, computer 20 is in"-" 

io tended to be representative of a broad category of data 
processing devices. 

Also shown in Figure 1 is a keyboard 30 for inputting 
data and commands into computer 20 through the I/O 
circuit 22, as is well known. It will be appreciated that 

'5 additional devices may be coupled to the computer 20 
for storing data, such as magnetic tape drives, and the 
like. A device control 36 is coupled to both the memory 
26 and the I/O circuit 22, to permit the computer 20 to 
communicate with multi-media system resources. The 

20 device control 36 controls operation of the multi-media 
resources to interface the multi-media resources to the 
computer 20. For example, in an interactive applications 
generator environment utilizing video, the computer 20 
may be coupled through the device control 36 to a video 

25 tape recorder 40, compact disc read only memory (CD 
ROM) 42, an audio tape recorder 44, and a disc player 
46. The device control 36 may comprise an independent 
control and interface device or a software process for ex^ 
ecution by the CPU 24. u ' 

30 a display monitor 50 is coupled to the computer 20 
through the I/O circuit 22. Any well known variety of cath*- 
ode ray tube (CRT), liquid crystal or other displays may 
be utilized as display monitor 50. A cursor control device 
52 includes switches 54 and 56 for signaling the CPU 24 

55 in accordance with the teachings hereof. Cursor control^ 
device 52 (commonly referred to as a "mouse") permits 
a user to select various command modes, modify graphic 
data, and input other data utilizing switches 56 and 54. 
More particularly the cursor control device 52 permits a 

•to user to selectively position a cursor 58 at any desired 
location on a display screen 60 of the display 50. As il- 
lustrated in Figure 1 . the cursor 58 is disposed within a 
window 65 in the present graphic user interface, to be 
described more fully below. Moreover, in the presently 

•*$ preferred embodiment, the present invention's win- 
dow-based user interface is generated and displayed us- 
ing software stored in either memories 26. 32 or CD ROM 
34. and executed by the CPU 24 

In the presently preferred embodiment, the cursor 

so control 52 utilizes well known apparatus and methods for 
signaling CPU 24 of position changes of cursor 58 by 
movement of the cursor control over a surface. However, 
it will be appreciated by one skilled in the art that a variety 
of well known cursor control devices may be utilized by 

55 the present invention, including other control devices 
such as mechanical mice, trackballs, joy sticks, graphic 
tablets, other keyboard inputs. The cursor control 52 in 
Figure 1 is intended to encompass all such equivalent 
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devices. 

The methods and apparatus embodying the inven- 
tion are utilized to generate application programs for op- 
eration in an interactive applications environment. An in- 
teractive applications environment may be implemented 
on any single server multi-client network computer sys- 
tem. In a preferred embodiment, the application pro- 
grams permit users, accessing the single server multi-cli- 
ent network, to interact with multimedia presentations. 
The interactive applications environment includes a 
graphical user interface (GUI) that permits a user to in- 
teract with multimedia presentations. The graphical user 
interface contains one or more display screens. In gen- 
eral the display screens are either menu screens or ap- 
plication screens. The menu screens permit selection of 
additional menu screens or application screens, and the 
application screens constitute a GUI for a particular ap- 
plication program. 

The present arrangement permits generation of cus- 
tomized interactive applications environments through 
use of an interactive applications generator. The interac- 
tive applications generator provides a means for a user 
to create a customized interactive applications environ- 
ment for a particular application. For example : an inter- 
active applications environment may be generated for an 
airline passenger entertainment system. Specifically, the 
interactive applications generator permits generation of 
customized logos, background colors and textures, 
graphical design style of controls including buttons and 
sliders, and a generalized look and feel of a graphical 
user interface for a particular application. 

The graphical user interface elements are derived 
from a generic screen template and are created through 
use of a screen editor. The generic elements of a screen 
template include a background, controls, corporate log- 
os, and display windows for displaying text and graphical 
information. Each display screen contains a correspond- 
ing screen template. In addition to screen templates, a 
display screen may also contain a media frame. The me- 
dia frame is displayed over a portion of the display screen 
or over the entire display screen. The screen templates 
contain all of the graphical user interface elements re- 
quired to customize a display screen for a particular ap- 
plication. The controls located on the screen templates 
provide functionality for the interactive applications en- 
vironment. 

The media frames are generated by the interactive 
applications generator via a media frame editor. The me- 
dia utilized in the media frames may consist of any mul- 
timedia subject matter. For example, in an airline pas- 
senger entertainment system, the multimedia subject 
matter may include duty free shopping product adver- 
tisements, photographs of a destination city, and desti- 
nation city maps. In addition to the multimedia subject 
matter each media frame may comprise one or more 
types of multimedia For example, a media frame may 
comprise a graphical image, a video clip, an animation 
sequence a sound clip, graphics, and blocks of text with 



display attributes. As will be explained more fully below, 
all multimedia subject matter associated with a particular 
media frame is loosely synchronized to a common time 
line so that each media frame contains exactly one time 
5 line. 

Each display screen has a unique existence within 
a particular interactive applications environment. How- 
ever, both screen templates and media frames may be 
shared by multiple instances of display screens. For ex- 
io ample, in the airline passenger entertainment applica- 
tion, a catalog shopping application program is con- 
structed to randomly change sequences of screen tem- 
plates to create multiple unique instances of display 
screens. For media frames, an image of a product may 
1S be used with multiple instances of display screens, 
wherein each display screen contains separate text tar- 
geted at different audiences. 

The airline passenger entertainment system pro- 
vides one example of an interactive applications environ- 
ment generated by an interactive applications generator 
embodying the invention. Although the airline interactive 
passenger entertainment system is provided as an ex- 
ample of an interactive applications environment, many 
other possible applications exist that share component 
elements similar to the airline interactive passenger en- 
tertainment system. Such interactive applications envi- 
ronments include business training systems, education- 
al systems for schools, library information systems, in- 
teractive cable or satellite home delivery of multimedia 
and television, on line equipment repair information sys- 
tems, health information systems, hospital patient enter- 
tainment systems, cruise ship passenger entertainment 
systems, bus and commuter train interactive multimedia 
delivery systems. In addition, applications exist that re- 
quire screen templates and or media frames as de- 
scribed herein. 

In a preferred embodiment, the interactive applica- 
tions generator of the present invention is a software tool 
for creating and modifying application programs for use 
in an integrated interactive applications environment. 
The interactive applications generator contains an inter- 
active presentation editor, a display screen editor, a 
screen template editor, and a me§(ia frame editor. In ad- 
dition, the interactive applications generator includes 
components for testing and checking the operation of the 
interactive applications environment prior to generation 
of a target output for the application programs. In gener- 
al, the interactive presentation editor allows the user to 
create hierarchical structures of screens. The screen ed- 
itor permits the user to reference a screen template and 
or media frames to create a unique instance of a display 
screen The screen editor also permits the user to attach 
controls to a particular screen display. The screen tem- 
plate editor permits a user to create screen template def- 
initions The media frame editor permits a user to com- 
bine multimedia component elements in a time synchro- 
nized fashion to produce a media frame. The four editors 
within the interactive applications generator also permit 
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modification of existing application programs and 
screens. 

In a preferred embodiment, a design rules checker 
and an application tester are utilized. The design rules 
checker providers a user with a means for logically test- 
ing an interactive applications environment to verify that 
the internal links and attributes are consistent throughout 
the interactive applications environment. For example, 
the design rules checker identifies one way cul-de-sac 
paths or completely unlinked screens. The applications 
tester provides a demonstration for the user so that the 
user may check the aesthetic functionality of an interac- 
tive applications environment. Specifically, the applica- 
tions tester allows an operator to identify a confusing 
screen sequence, timing problems or inappropriate la- 
beling of controls. 

The interactive applications generator provides a 
means for organizing work created in ,, projects M ! wherein 
each project identifies a separate interactive applications 
environment. A new project is opened to begin creating 
a new interactive applications environment. Opening a 
new project creates a set of files to store the component 
elements of a project. Each editor, within the interactive 
applications generator contains a file for the project. All 
of the files for a project have a common name, but each 
of the files has a unique file extension. A user of the in- 
teractive applications generator can open only one in- 
stance of the interactive presentation editor. However, 
multiple instances of the screen editor, screen template 
editor, and media frame editor may be opened simulta- 
neously. This configuration permits flexibility such that a 
user may work on the component elements of a single- 
project but the user is precluded from opening more than 
one project at a time. The interactive applications gen- 
erator permits a user to begin at any category block ex- 
cept for the design rules checker and the applications 
tester • . • 

Figure 2 illustrates, in Booch notation, a program 
hierarchy for the interactive applications generator con- 
figured in accordance with an embodiment of the inven- 
tion. The interactive applications generator contains four 
primary component programs: an interactive presenta- 
tion editor 200: a screen template editor 2T0: a screen 
editor 220: and a media frame editor 230. The interactive 
presentation editor 200 is shown, in Figure 2 as a top 
layer for the interactive applications generator. In order 
to create an interactive applications environment for a 
particular application, a user may begin a project utilizing 
a top to down design methodology by beginning with the 
interactive presentation editor 200. In general, the inter- 
active presentation editor 200 permits a user to build a 
skeleton to define a screen hierarchy. Alternatively, a 
user may begin a project utilizing a bottom to top design 
methodology by first creating the screen templates and 
media frames. The interactive applications generator 
provides menu selections for each of" the four primary 
component programs to allow: invoking an instance: re- 
turning to an existing instance: or returning to any of the 



other primary component programs. A windows group 
box with icons for each of the four primary component 
programs provides flexible entry access to the interactive 
applications generator. 
s The interactive presentation editor provides the ca- 

pability to link together a set of menus and application 
screens to create a particular interactive applications en- 
vironment. Specifically, the interactive presentation edi- 
tor permits the operator to organize and display screens 

to in a screen hierarchy. In the interactive presentation ed- 
itor, the screens are represented as symbols for manip- 
ulation by the user. The screen hierarchy establishes 
paths for the display screens to define an interactive ap- 
plications environment. The screen hierarchy is organ- 

? 5 jzed in hierarchical levels, such that a user selects a 
screen at one level of the hierarchy to permit entry into 
subsequently more detailed levels of the hierarchy. For 
purposes of explanation, child display screens are de- 
fined as those display screens having a parent display 

20 screen located in the next higher hierarchical level. In 
order to establish the screen hierarchy for a particular 
interactive applications environment, each child display 
screen is linked to a control on the respective parent dis- 
play screen. In addition, paths, known as back paths, for 

25 exiting the display screen are also created. These back 
paths typically return the user to a higher level in the hi- 
erarchy. ■ ^ - 
Figure 3 illustrates a graphical user interface (GllJI) 
for an interactive presentation editor configured iniac- 

30 cordance with an embodiment of the invention. In a pre- 
ferred embodiment of the present invention, a GUIms 
generated on the computer system via operation in the 
Microsoft™ Windows operating system environment. 
The GUI for the interactive presentation editor 200 con- 

3S tains a title bar 300, menu bar 310, system menu button 
312, and minimize and maximize buttons 314 and 315, 
respectively, in addition, the GUI for the interactive pres- 
entation editor contains a tool bar 318 containing a 
number of icons. The icons are used to represent com- 

-to monly used functions such as the rules checker and the 
applications tester. The display of the tool bar 318 is tog- 
gled either to an "on" or M off M state." A status bar 320 is 
used to display informational messages to aid the' oper- 
ator. For the GUI shown in Figure 3. a description for the 

-*s icon under the cursor control device, the current zoom 
ratio, and zone restrictions are shown. In addition, scroll 
bars 325 permit panning of the graphical display in both 
horizontal and vertical directions. A depth ruler 330 dis- 
plays the hierarchical level in the screen hierarchy for the 

so corresponding display screens. 

The interactive presentation editor 200 utilizes dis- 
play screen identifiers to graphically represent display 
screens for arrangement by a user to create a particular 
interactive applications environment. Generally, display 

55 screens consist of menu screens and * application 
screens. A menu display screen permits selection of an- 
other menu display screen or an application display 
screen. An application screen is a GUI for a particular 
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application program. A rectangular display screen iden- 
tifier represents a menu screen, and an oval display 
screen identifier represents an application display 
screen. In order to select a display screen from the in- 
teractive presentation editor 200. the user selects the re- 
spective display screen identifier through use of a cursor 
control device. When a particular display screen is se- 
lected, a dialog box for the corresponding display screen 
is invoked. For a menu display screen, the dialog box 
permits a user to enter specific display screen informa- 
tion. For example, a user may enter: the text description 
of the screen: a screen identifier linking the screen to a 
media frame and a screen template: a list of each control: 
and a link to either an application or sub-menu screen. 
In addition, other attributes defining classifications for 
use of the display screen may be entered. Furthermore, 
information may be automatically entered into the data- 
base without use of the dialog box if a display screen is 
selected from a screen catalog. The operation and use 
of a screen catalog is described more fully below. 

If the menu or application display screen is linked to 
additional menu and/or display screens, then the menu 
or applications display screen identifier contains "a three 
dimensional shadow". For example, the meal and bev- 
erage menu display screen identifier illustrated in Figure 
3 contains additional menu and application display 
screens. When viewing the screen hierarchy via the in- 
teractive presentation editor, one interactive presenta- 
tion path is highlighted. For the example screen hierar- 
chy illustrated in Figure 3, the display screens: "wel- 
come", ICS main", "entertainment", and "games", that 
comprise the active interactive presentation path, are 
highlighted. 

If a user selects an application screen, a dialog box 
is invoked, permitting entry of application specific infor- 
mation. The interactive presentation editor 200 allows a 
user to link menu screens to application screens. Figure 
3 illustrates an example of a four level screen hierarchy 
for an airline passenger entertainment interactive envi- 
ronment. The hierarchical path begins with a "welcome" 
menu display screen. The "welcome" menu display 
screen permits a user to select the "ICS main" menu or 
the "customization" menu. From the ICS main menu, the 
entertainment, meal and beverage and passenger menu 
screens are selectable. From the entertainment menu 
display screen, a number of application display screens 
are selectable. For the example shown in Figure 3 : an - 
audio, video, games, pay-per-view video and 
pay-per-view games application screens are shown as- 
sociated with the entertainment menu display screen. If 
the user, via a cursor control device, double-clicks on the 
games application display screen, a list box : showing 
one or more screen identifiers describing a set of screens 
for the selected application, are displayed. 

Figure 3 illustrates screen identifiers for the games 
applications in a fifth hierarchical level. Also shown in the 
fifth level are arrows, labeled 327 and 329. that permit 
the user to scroll through the screen identifiers in either 



a right or left direction, respectively. For groups of select- 
ed menu and or application screens, double-clicking on 
any of the selected display screens permits a user to en- 
ter information pertaining to a group level. For example, 
5 a user may set restrictions or availability of certain 
screens based on a group level classification. For the 
airline passenger entertainment system, restricted ac- 
cess may be categorized by area zone, flight phase, age 
restriction, and special passenger information. 

io The interactive presentation editor determines the 
association of child screens to menu parent display 
screens automatically. The determination is based on 
the left to right ordering of the application screens in the 
hierarchy, and the ordering set forth for each control 

15 when the corresponding screen template is created. If 
too many controls or too many child-screens are associ- 
ated with a parent screen, the operator of the interactive 
applications generator is prompted to correct the error 
during the design check phase. 

20 Figure 4a illustrates a file menu for the interactive 
presentation editor configured in accordance with an em- 
bodiment of the invention. The file menu selection on the 
interactive presentation editor GUI permits a user to 
open a new file. Upon invocation of the "new" function. 

25 a windows common dialog box is invoked to open a new 
file. An "open" function permits a user to open a new or 
existing file within the screen hierarchy. The interactive 
presentation editor files are given the file extension 
MPE". When the file open function is selected, only files 

30 ending with the MPE" extension are displayed for selec- 
tion by the user. A "close" function in the file menu closes 
the active file currently opened. In order to avoid discard- 
ing updated information during an editing session, a user 
is prompted to save changes if edits were made to the 

35 file subsequent to the last save operation. A "save" func- 
tion permits a user to save the currently opened file to 
disk. When selected, a windows common dialog box is 
invoked to save the active MPE" file. 

A "save as" function in the file menu permits a user 

•to to save the active IPE file under a new name. A file ex- 
tension of IPE is automatically added to the name se- 
lected. A print function within the file menu permits a user 
to print the active screen hierarchy or a subset of the cur- 
rent screen hierarchy. Options for the print function in- 
elude printing the current view on display, the current tree 
hierarchy being edited, or a set of selected display 
screens. A "print setup" function within the file menu per- 
mits a user to set up the printer environment. Finally, the 
"exit" function within the file menu permits exiting the ac- 

so tive open file within the interactive presentation editor. If 
the active IPE file has not been saved upon invocation 
of the exit function, the user is prompted to save the file 
before exiting. 

Figure 4b illustrates an edit menu for the interactive 

55 presentation editor program configured in accordance 
with an embodiment of the invention. The edit menu con- 
tains an "undo" function command that allows a user to 
repeatedly back out of the last "n" operations up to a 
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lects the reduce command from the view menu. After the 
user selects the reduce command, the physical portion 
of the hierarchical screen display is reduced to the 
screen displays-as shown in Figure 8b. 

A "back paths" function is selectable from the view s 
menu as shown in Figure 4c. In a preferred embodiment 
of the present invention, back paths are defined as 
routes, within the menu screen hierarchy, that a user may 
utilize to directly exit a particular screen menu selected. 
Because viewing back paths may confuse the overall 10 
screen hierarchical structure, the output display does not 
show the backpaths when operating in the default mode. 
In addition, the back paths are always shown in an at- 
tention color such as red. The back paths function tog- 
gles the display of back links, associated with a menu '5 
display screen hierarchy, on and off. ~ 

A levels function, within the view menu, toggles the 
display of the depth ruler display "on" and "off". A check 
mark is displayed beside the levels function in the view 
menu when the depth ruler is displayed. A tool bar com- 20 
mand, selectable within the view menu, toggles the dis- 
play of a tool bar display "on" and "off". A check mark 
appears beside the tooi bar function on the view menu 
when the tool bar is displayed. A status bar command, 
selectable from the view menu, toggles the display of the 25 
status bar "on" and "off". A check mark is placed beside 
the "Status Bar" function when the status bar is dis- 
played. A screen catalog function, selectable from the 
view menu, activates and deactivates a screen catalog 
window. The screen catalog window permits a user to 30 
scroll through a screen set for a particular application. A 
user may select a screen within the screen set display 
for insertion into the current screen hierarchical struc- 
ture. The selection of a screen via the screen catalog 
window permits the interactive presentation editor to 35 
maximize the amount of information set automatically. A 
screen catalog configured in accordance with an embod- . . -r 
iment of the invention is described more fully below. 

A tree subset function is also selectable from the 
view menu shown in Figure 4c. The tree subset function -to 
permits restriction to menu screens based on classifica- 
tion information. The tree subset command permits a 
user to view a given sub-diagram of the overall menu 
screen hierarchical structure. The sub-diagram is gener- 
ated by selecting one or more restriction options. The -is 
tree subset function allows a user to easily edit and check 
the menu screen hierarchy for each classification or cat- 
egory. Figures 9a-b illustrate an example of the tree 
subset function configured in accordance with an em- 
bodiment of the invention. Figure 9a illustrates an ex- so 
ample of an adult category for a layout of a menu screen 
hierarchical structure. Note that the selected application 
screen (e.g. videos) shows a number of videos suitable 
for an adult. Also note that the status line 320 indicates 
that the menu screen structure corresponds to a first 55 
class adult passenger. Upon selection of a new tree type, 
via the tree subset command, the interactive presenta- 
tion editor revises the menu hierarchy accordingly. Fig- 



ure 9b illustrates an example of a menu screen hierar- 
chical structure for a first class child passenger. The en- 
tertainment options requiring money transactions and 
specific adult oriented movies were removed from the 
output display screen, thereby making these selections 
non-accessible to a child. 

An operations menu for the interactive media pres- 
entation editor is shown in Figure 4d. The operations 
menu provides a number of commands to allow the user 
to add a new menu screen, establish a link, and insert a 
display screen. As discussed above, a menu screen con- 
tains controls that permit a user to navigate through the 
particular interactive application environment. For exam- 
ple, menu screens are used to group related items to- 
gether in the screen hierarchical structure. A menu 
screen command, selectable from the operations menu, 
is a drag and drop type command. Upon invoking the 
menu screen function and selecting a menu screen, the 
selected menu screen may be placed at any level within 
the screen hierarchical structure. After the selected 
menu screen is placed, the user, via a dialog box. may 
enter information pertaining to the selected menu 
screen. Moreover, information may be added by the user - 
at a later time by double-clicking on the screen identifier 
for the particular menu screen with the cursor control de- 
vice. _ .■ 

If a menu screen is dropped within the-parent menu 
screen (i.e. the placement of the new menu;screen iden- - ; 
tifier overlaps a parent menu screen display), then a for- 
ward link is automatically established. If desired by the 
user, parent menu screen information may be entered at 
this time. Figure 10 illustrates an example of the func- 
tionality of the menu screen command. For the example 
illustrated in Figure 10, an information services menu 
screen is added. Note : because the new menu screen 
was not dropped onto an existing menu screen, the new 
menu screen is unattached. Because of this, a forward 
link is established at a later time. 

An application screen command, selectable within 
the operations menu, is shown in Figure 4d. The appli- 
cation screen command allows a user to add a new ap- 
plication screen to the screen hierarchical structure,- As - 
discussed above, an application screen is located at the 
final destination of a given menu path in an interactive 
applications environment. Application screens are com- 
monly used in conjunction with other application 
screens. An application screen contains forward and - 
backward control buttons, wherein the function of these 
buttons is predefined to enable the user to move through 
the group of application screens. 

In a preferred embodiment, application screens, 
contained in a particular application screen group, exhib- 
it a left to right ordering. The left to right ordering defines 
the movement through the application screens in a par- 
ticular application screen group. For example, in the air- 
line passenger entertainment application, a duty free 
shopping application group may contain many applica- 
tion screens for sale of different items. The application 
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point. The number of undo operations is a user defined 
option such that the user may pre-configure the number 
in a configuration program. The interactive presentation 
editor program edit menu also includes a standard win- 
dows "cut" function. The cut function allows the user to 
cut or delete logical items in the program. The deleted 
items are placed in the windows clip board or buffer. The 
cut function permits a user to select screen menus, in- 
cluding the screen menu associated hierarchies, for re- 
moval or relocation. The edit menu also displays a stand- 
ard windows copy function which allows a user to copy 
logical items in the program. Upon invocation of the copy 
function, the logical items are placed in the windows clip 
board. For the interactive presentation editor program, 
the copy operation copies selected screen menus, in- 
cluding the screen menu associated hierarchies, to other 
hierarchies. In addition, the copy operation may be uti- 
lized as an editing shortcut when a portion of the screen 
hierarchy is similar. 

The edit menu also includes a standard windows 
"paste" function allowing a user to paste or insert logical 
items currently stored in the windows clip board. A "de- 
lete" function is also included in the edit menu. The de- 
lete function is analogous to the cut function, except that 
the information is not copied to the clip board. Items in 
the interactive presentation editor program may also be 
deleted by selecting the object and pressing a delete key 
on the host computer keyboard. The "find" function, se- 
lectable within the edit menu, permits a user to search 
for a particular display screen. A user may search on the 
screen text description or a screen identifier. If the dis- 
play screen sought is found, the screen is selected and 
displayed on the monitor so that the selected screen ap- 
pears within the current view window. A "replace" com- 
mand, selectable from the edit menu, allows execution 
of a search and replace function in the interactive pres- 
entation editor program. For example, the replace func- 
tion permits scanning of all display screens for a given 
media frame for replacement with another. Confirmation 
of each replacement function selected and global re- 
placement is an option. 

Figure 5 illustrates a screen identifier movement 
operation via the interactive presentation editor. For the 
example shown in Figure 5. the user desires to move 
application screens Pay-per-View Video and 
Pay-per-View Games to a next higher hierarchical level. 
First, the application screens, pay-per-view video and 
pay-per-view games, are selected as indicated by the 
dotted rectangular box labeled 500 on Figure 5. The se- 
lected application display screens are then cut via the 
cut function, and are subsequently stored in the windows 
clipboard. A user then selects a new parent screen such 
as the pay-per-view entertainment menu display screen. 
Upon selection of the menu display screen, the interac- 
tive presentation editor joins the screens graphically as 
shown in Figure 6. 

The interactive presentation editor GUI illustrated in 
Figure 6 connects, via a dotted line, the pay-per-view 



entertainment menu screen to the pay-per-view video 
and pay-per-view games application display screens. 
The dotted line indicates that the pay-per-view video and 
pay-per-view games application screens contain con- 

5 trols that are not defined to the parent screen. The place- 
ment of the pay-per-view video and pay-per-view games 
application screens automatically expands the corre- 
sponding hierarchical level to show the new placement. 
Because only one branch of a parent menu is expanda- 

io ble at any one particular time, the audio, video and 
games application screens were reduced into the enter- 
tainment menu screen, and the entertainment menu dis- 
play identifier was changed accordingly. 

Figure 4c illustrates a view menu for the interactive 

'5 presentation editor configured in accordance with an em- 
bodiment of the invention. The interactive presentation 
editor contains a "zoom" function, selectable from the 
view menu, that allows a user to zoom in or out of the 
current display window. The user controls the zoom func- 

20 tion through use of a zoom scale factor. The zoom func- 
tion enables the user to focus upon a selected portion of 
the current output display. The interactive presentation 
editor scales the selected portion to fit the display win- 
dow. The "expand" command, also selectable from the 

25 view menu, allows a user to expand a menu screen 
group or an application screen group. A selected menu 
screen group is graphically expanded into a sub-menu 
structure. The level of expansion into the sub-menu 
structure depends upon an option initially set by the user. 

30 if expanded to show all levels, then each hierarchical lev- 
el stops at a final menu screen or an application group. 
Alternatively, a selected application group expands into 
a separate screen. The selected application group is dis- 
played showing the first "n" application screens, with for- 

35 ward and backward buttons. The direction buttons allow 
navigation through the set of screens comprising the ap- 
plication group. 

Figures 7a-b illustrate an example of the expand 
command configured in accordance with the interactive 

•to presentation editor. 

Figure 7a illustrates an example of a screen hier- 
archy for an interactive presentation environment. To ex- 
pand the meat and beverage menu display screen, the 
user, through use of the cursor control device, selects 
the meal and beverage menu display screen identifier 
on the output display. Figure 7b illustrates the output 
display after execution of the expand command on the 
meal and beverage menu display screen identifier. 

A reduce command, selectable from the view menu, 

50 allows a user to reduce a selected menu group or appli- 
cation group in the screen hierarchy. The reduce com- 
mand allows a user to concentrate on a particular area 
of interest without viewing overall complexities in the en- 
tire screen hierarchical structure. Figures 8a-b illustrate 

55 the reduce command for an example screen hierarchy. 
For the example illustrated in Figure 8a. a user selects 
a meal and beverage menu display screen. Upon selec- 
tion of the meal and beverage display screen, a user se- 
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screen command is a drag and drop type command, 
whereby the application screen may be placed at any 
level within the screen hierarchical structure. After the 
application screen is placed within the screen hierarchi- 
cal structure, the user may enter information pertaining 
to the application screen either now : or at a later time. A 
parent screen is automatically assigned to the selected 
application screen based on the application group. If the 
selected application screen was a first screen within a 
particular application group, a connection is established 
in the same manner as a menu screen. 

Figures 11 a-11 b illustrate the operation of adding 
an application screen to a screen hierarchical structure 
in accordance with an embodiment of the invention. For 
the example shown in Figure 11 a, a chess application 
screen is selected, via the application screen command, 
and the corresponding screen identifier is attached to the 
cursor so that the user may place the application screen 
in an application group. For the example, the chess ap- 
plication screen is placed within the games application 
group. Figure 11b shows the output display after the 
chess application screen is added to the games applica- 
tion group. Note that the chess application screen ap- 
pears at the far right of the application group, and the 
interactive presentation editor program automatically 
scrolls all other application screens to the left. 

A forward path command, selectable from the oper- 
ations menu, is shown in Figure 4d. The forward path 
command establishes a link from a control in a menu 
screen at a "n" level to a menu or application screen at 
a "n+1 " level. Although the forward path command con- 
nects' application and menu screens to controls, the 
standard drag and drop procedure is the preferred pro- 
cedure for making a forward path link. Figure 12a illus- 
trates the creation of a forward link via the forward path 
command for an example screen hierarchical structure. 
For the example screen hierarchical structure, a forward 
link is created between an information services menu 
screen and an ICS main menu screen. The forward link 
is established by selecting the two associated menu 
screens with the cursor control device. In response to 
selecting the forward path command, a mock screen 
template of the parent menu is graphically created allow- 
ing the user to pick the control from the screen template. 
The selection of the control on the parent menu screen 
establishes the link to access the child menu screen. 
Figure 12b illustrates the menu hierarchical structure 
after creation of the forward link between the ICS main 
menu screen and the information services menu screen. 

For a typical application, when a child screen is ex- 
ited, the program returns control to a parent screen. The 
return of control to a parent screen from a child screen 
is the default mode of operation in setting up an interac- 
tive applications environment with the interactive appli- 
cations generator. However, in some cases, it is desira- 
ble to jump back several levels to exit a particular child 
screen. Therefore, the present arrangement provides a 
back path command selectable from the operations 



menu that allows a child screen to exit to a screen other 
than the parent screen. The back path command estab- 
lishes a back link as an override to the default mode of 
operation. To establish a back link, source and destina- 
5 tion screens are selected by the cursor control device. 

Figure 1 3a illustrates an example of a screen hier- 
archy structure for the operation of the back path com- 
mand. For the example shown in Figure 13a. an enter- 
tainment menu screen and a welcome menu screen are 
io the source and destination screens, respectively/for the 
back path command. The operation of the back path 
command to create a back path is analogous to the op- 
eration of the forward path command explained above. 
Once a back link has been established, and if a forward 
is link exists, the forward link is changed from a solid line 
to a dashed line as shown in Figure 13b. The dashed 
line represents the one way nature of the forward link. In 
addition, the back link path is only shown when a 
view/back path option is selected. 

An advertisement (ad) insertion command, selecta- 
ble from the operations menu, permits the user to insert 
an advertisement before a particular screen is displayed. 
The advert is ement begins each time the associated, 
screen is selected. Upon completion of the advertise- 
ment, the associated screen is displayed. For example, 
for the airline passenger entertainment system, an 
"In-flight games are brought to you by XYZ Enterprises, " 
advertisement may be displayed before entering into a 
games menu screen. When a path to a screen contains 
an associated advertisement, the screen icon is dis : 
played with a M $ M icon. 

Figure 4e illustrates a tools menu for the interactive 
presentation editor program configured in accordance 
with an embodiment of the invention. A screen editor 
command is shown selectable from the tools menu.. The 
screen editor command permits a user to access the 
screen editor program. For example, a user may wish to 
create/edit an actual menu screen or application screen 
when working within the screen hierarchy structure. Al- 
though the screen editor is typically run separately, pro- 
viding access to the user during operation of the interac- 
tive presentation editor program is desirable to provide 
greater flexibility in the design process. Also shown se- 
lectable from the tools menu is a screen template editor 
command. The screen template editor command pro- 
vides access to the screen template editor program. The 
screen template editor command allows the user to cre- 
ate/edit the actual screen templates while working within 
the screen hierarchy. A menu frame editor command is 
also selectable from the tools menu. Similarly, the media 
frame editor allows a user, to access the media frame 
editor program while operating within the interactive 
presentation editor program. A user may wish to cre- 
ate/edit the actual media frames while working within the . 
screen hierarchy. 

A design check command, selectable from the tools 
menu, invokes the design check program. The design 
check program is used to perform a variety of information 
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and error checks within the current screen hierarchy. The 
design check program identifies potential problems in- 
cluding identifying missing information and circular menu 
screen paths. For example, the design check program 
identifies menu screens that are not attached to a spe- s 
cific control in a corresponding parent screen. The de- 
sign check program also identifies controls in a menu 
screen that do not have a corresponding application or 
menu screen attached. Furthermore, the design check 
program identifies screens that have not been linked to 10 
a parent screen. Finally, the design check program iden- 
tifies screens situated in endless loops, such that a 
screen does not have a forward and backward link from 
another screen within the screen hierarchy. The design 
rules used by this design check program can be flexibly '5 
configured via a dialog box. 

Figure 14 illustrates an example of a screen hier- 
archical structure during the design check process. 
When an error is detected by the design check program, 
a display box : such as display box 1700, is displayed 20 
The display box 1700 identifies any errors detected. In 
addition, the display box permits a user to fix, continue 
or cancel the design check program. For the design 
check program, a screen identifier icon is highlighted to 
identify the screen where the error was detected. For the 25 
example shown in Figure 14 : the entertainment menu 
screen does not have controls attached, and therefore 
is highlighted. 

Figure 4e illustrates a regenerate command se- 
lectable from the tools menu. The regenerate command 30 
regenerates the screen hierarchy after edits occur. For 
example, after editing and moving the screen identifier 
icons, the resulting screen hierarchy may be displayed 
having links that are criss-crossed. Upon invocation of 
the regenerate command, a new graphical representa- 3$ 
tion in a top - to-bottom : left-to-right ordering is displayed. 
Figure 15a illustrates an example screen hierarchy after 
editing, but prior to execution of the regeneration com- 
mand. Note that the Information Services menu screen 
and the display menu screen are displayed within menu 40 
screens having a different parent menu screen. Figure 
1 5b shows display of an example screen hierarchy after 
execution of the regeneration command. The screen hi- 
erarchy displayed in Figure 15b more clearly shows the 
hierarchical structure. 45 

An edit mode command is shown selectable from 
the tools menu in Figure 4e. The edit mode command 
sets the mode of operation for the interactive presenta- 
tion editor program. The edit mode is the normal mode 
of operation for the program, and permits the user to edit so 
the current design. The edit mode is used to return from 
the test mode. When the interactive presentation editor 
operates in the edit mode, a check mark resides beside 
the edit mode command on the tools menu. Also shown 
on the tools menu in Figure 4e is a test mode command ss 
The test mode command switches the mode of operation 
from the edit mode to the test or demonstration modes. 
A check mark resides beside the test mode command 



124 A1 




on the tools menu when the interactive presentation pro- 
gram is in the test mode. 

Figure 4f illustrates a help menu for the interactive 
presentation editor program configured in accordance 
with an embodiment of the invention. The help menu dis- 
plays a "Help Index..." and "About" commands. The Help 
Index command is a standard windows help index type 
function. Generally, the help index command permits a 
user to select from a category index to obtain help infor- 
mation for operation of the interactive presentation editor 
program. The about command is also a standard win- 
dows type about box utilized for windows programs. The 
about box, when selected, displays title, copyright, and 
version information pertaining to the interactive presen- 
tation editor. 

The screen editor program provides capabilities to 
create screens utilized in the interactive applications en- 
vironment. A screen contains two parts: a reference to a 
generic screen template, and a set of information specific 
to the screen (actual controls and media frames) that 
customizes the screen template for an unique interactive 
applications environment. To generate a screen with the 
screen editor program, a screen is first associated with 
a screen template. A window on the output display dis- 
plays a graphical representation of the screen template. 
To generate media frames, information is supplied by 
choosing from a media frame catalog, or by typing an 
identification code to specify media data. For controls as- 
sociated with a screen, an operator supplies the text to 
define all buttons and controls. For controls accessing 
one of the pre-defined libraries, an operator assigns 
functionality to the control by choosing from the function 
library catalog. Controls activating a new screen are au- 
tomatically assigned by the one to one correspondence 
between the ordering of the template and the structure 
within the interactive presentation editor. 

Each control or media frame area located on a par- 
ticular screen template is selectable by the cursor control 
device. To select a control or media frame, the user dou- 
ble-clicks on the area with the cursor control device, and 
an information box is subsequently displayed by the 
screen editor program. For a control, the information box 
displays the control text and any attached functionality. 
For a media frame, the information box displays an as- 
sociated identification. Although the preferred manner of 
entering information is through the drag and drop inter- 
face, information may be entered in the information box 
directly by the user. However, for the associated text re- 
lating to a particular control, the information box is the 
only means to enter data. In addition, information is sup- 
plied in a read only type fashion for defined controls in 
media frames. The defined controls are preset within the 
template definition (e.g. an abort function). Defined me- 
dia frames are preset within the template definition, nor- 
mally for common text captions. The ability to graphically 
select controls and or media frames on the screen tem- 
plate provides an easy user interface to enter the screen 
specific information As screen specific information is en- 
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tered, the screen template is transformed so that the user 
can evaluate the output display screen. The screen def- 
inition maintains a reference to the screen template. 
Therefore, when a screen template changes (e.g. a new 
logo is desired), then, by definition, all screens using that s 
particular screen template as a reference are automati- 
cally updated. 

Figure 16 illustrates a GUI for the screen editor con- 
figured in accordance with an embodiment of the inven- 
tion. In a preferred embodiment, the screen editor pro- w 
gram is implemented to operate in conjunction with a 
windows operating system. The screen editor program 
contains features such as a title bar 2000 : a menu bar 
201 0, a system menu button 2015, and windows mini- 
mum/minimum buttons 2020. In addition., other Micro- 15 
soft™ Window features are provided such as a tool bar 
2025, a status bar 2030 and scroll bars 2035 and 2037. 
The operation of the title bar, menu bar, system menu 
button, tool bar, status bar and scroll bars are described 
above in conjunction with the interactive presentation ed- 20 
itor. 

Figure 17a illustrates a file menu for the screen ed- 
itor configured in accordance with an embodiment of the 
invention. The file menu for the screen editor contains a 
number of commands to manipulate files within the 25 
screen editor program. A "new" command, selectable 
from the file menu, creates a new screen project file. If 
a project. file is currently opened, the user is prompt to 
save any changes before the new screen project file is 
created. An "open* 1 command permits a user to open a 30 
new or an existing screen project file. To open a new or 
existing project file, a windows common dialog box is in- 
voked. The screen project files contain the file extension 
" SCR". During the file load selection, only files contain- 
ing the file extension SCR are displayed for selection. 35 

A "close" command closes the currently active 
screen project file. The user is prompted to save changes 
if edits were made subsequent to the last save operation. 
A "save" command saves the active screen file to a per- 
manent storage device. A windows common dialog box -to 
is invoked in order to save the screen project file. If no 
name is assigned to the currently open screen project 
file, then the user is prompted with a "save as" command. " 
The "save as" command, also selectable from the file 
menu, saves the active project file under a new name. A ^5 
windows common dialog box is invoked in order to save 
the active screen project file. A file extension of SCR is 
automatically appended to the name given by the user. 
The "Save As" command contains an option in the file 
save dialog box to automatically save the edits in all ac- so 
tive child windows. Otherwise, the user is prompted to 
save changes for each open child window. 

A "New Screen" command opens a child window in 
order to create a new screen for addition to the screen 
project file. To open a new screen, the user supplies a 55 
valid screen template name to associate a screen tem- 
plate for the new screen. When the child window is 
closed, the user cancels the edits or adds the screen to 
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the "update list" used during save operations. The "Open 
screen" command opens a child window in order to edit 
an existing screen within the screen set for the project 
file. A dialog box is invoked in order to search the screen 
set for a particular screen. When opening a new screen, 
the operator cancels the edits or adds the screen to the 
update list. A "Print" command permits a user to print the 
active screen. A windows common dialog box is invoked 
to print the screen. A "Print Setup" command also in- 
vokes a windows common dialog box in order set up the 
printer environment. In addition, an "Exit" command per- 
mits the user to exit the screen editor program. If any 
updates are made to screens currently active, the user 
is prompted to save changes before exiting. 

Figure 17b illustrates an edit menu for the screen 
editor program configured in accordance" with an embod- 
iment of the invention. The edit menu contains a number 
of commands to manipulate screen sets in the screen 
editor program. An "Undo" command allows the user to 
undo the last "n" edit operations. The number of revers- 
ible operations is a user defined option that is set in the 
configuration program. In the screen editor program, an 
"Undo" operation resuits in negating information sup- 
plied for the control areas and media frames. A "Delete" 
command allows the user to erase the associated infor- 
mation for a control or media frame from the database. 
A "Delete All" command, when selected, invokes a dialog 
box to allow the user to delete all associated information 
for a particular set of controls, media frames, or any com- 
bination thereof. The delete all command is useful for 
creating a new screen with the current screen template, 
without having to remember the screen template name. 
The "find" command permits a user to locate information 
associated with a control or media frame. For example, 
a user may search based on the name of a media frame 
or the text associated with a particular control on the 
screen. 

Figure 17c illustrates a view menu for the screen 
editor program configured in accordance with an embod- 
iment of the invention. In general, the view menu permits 
the user to select a number of commands relating to the 
display of information associated with the screen editor 
program. A "zoom" command allows the user to set the 
area of display on the output display device. The user 
may either apply a zoom scale factor or select a window 
portion of the output display device. If the user selects a 
window portion of the current display, the selected win- 
dow area is scaled to fit the window display area. A "tem- 
plate mode" command permits a user to place the screen 
editor program in the template mode so that only the view 
of the screen template is shown. The template mode 
does not display screens with the external media frame 
files thereby allowing quick edits. - 

A "display mode" command places the screen editor 
program in a display mode. The display mode permits a 
user to update a view of the screen as information is sup- 
plied. For example, when a media frame is assigned to 
an area on the screen template, the actual media frame 
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image is displayed on the selected area. The display 
mode is the default mode because it ensures to the op- 
erator that the correct data is being supplied to the dis- 
play screen. A "media frame" catalog command toggles 
a media frame catalog "on" and "off" the display screen. 
A check mark located beside the media frame catalog 
command on the view menu indicates the media frame 
catalog is displayed. In general, the media frame catalog 
is a separate window that permits a user to scroll through 
a list of media frames. The media frame catalog assists 
a user by selecting a specific media frame, and by plac- 
ing the selected media frame on an area of the screen 
layout. 

Figure 18 illustrates an example of a media frame 
catalog window configured in accordance with an em- 
bodiment of the invention. The graphics display portion 
2400 of the media frame is displayed along with a de- 
scriptive name. For the example shown in Figure 18, 
the media frame is associated with the text description 
"Los Angeles Tourist drawing". In addition, the media 
frame file "LA.MFR" identifies the file containing the me- 
dia frame. A select button 2410 is shown on the media 
frame catalog window. The select button 2410 is utilized 
to drag a selected media frame icon over a media frame 
area on the screen layout to create the association be- 
tween the area and the particular media frame selected. 

The present arrangement includes a function library 
catalog. The function library catalog is a separate win- 
dow that allows the user to scroll through a library of pre- 
defined functions. The function library catalog permits 
the user to assign a specific function to a control on the 
screen layout. Figure 19 illustrates an example of a 
function library catalog window configured in accordance 
with an embodiment of the invention. Each function con- 
tained within the function library has an associated text 
description and an icon box. In addition, the user may 
scroll through the list of files contained in the function 
library catalog for selection of the desired function. For 
the example shown in Figure 19. the "SHOPSUM.API" 
file is active, therefore the associated text description 
and icon box are shown. The files for the function library 
are given the file extensions "API". 

A select button 2405 permits a user to drag the icon 
box 2420 over a control button on the currently displayed 
screen. If the users drags the icon and places the icon 
over a control button, the screen editor program auto- 
matically creates an association between selection of the 
button and invocation of the function. Note that controls 
that activate screens are automatically assigned func- 
tionality through use of the interactive presentation editor 
program. Only controls performing other functions (e.g. 
handle credit card transactions) are assigned using the 
function library catalog. However, the function library cat- 
alog may be used to implement any function. For exam- 
ple, the function library catalog may be used to: purchase 
merchandice "PURCHASE. API": reset the menu to the 
original parent screen "RESET API"; select a language 
for the menu "LANGUAGE. API": advance to the next 



screen "NEXTSCR. API": return to the previous screen 
"PREVSCR.API"; and abort a menu "ABORT.APr 

Figure 17c illustrates a control function catalog 
command selectable from the view menu. The control 
5 function catalog command toggles the control function 
catalog "on" and "off". A checkmark located beside the 
control function catalog command on the view menu in- 
dicates the function is active. A tool bar command on the 
view menu toggles the tool bar display "on" and "off". A 
io check mark located next to the tool bar command on the 
view menu indicates the tool bar is displayed. Similarly, 
a status bar command toggles the status bar on and off. 
A check mark next to the status bar command on the 
view menu indicates that the status bar display is active. 

is Figure 17d illustrates a tools menu for the screen 
editor configured in accordance with an embodiment of 
the invention. The commands selectable from the tools 
menu permit a user to invoke different programs while 
maintaining the screen editor program active An inter- 
na active presentation editor command permits the user to 
access the interactive presentation editor program. A 
screen template editor command allows a user to access 
the screen template editor program. Access to the 
screen editor template program from the screen editor 

25 program permits the user to create/edit a screen tem- 
plate while working on creation of the actual screens. A 
"media frame editor" command permits access to the 
media frame editor program. The media frame editor 
command permits the user to create/edit a menu frame 

30 while working to create screens. 

An "edit" mode command allows a user to select an 
operating mode for the screen editor program. The edit 
mode, which is the normal mode of operation for the 
screen editor program, permits the user to edit an active 

35 screen. When in the edit mode, the edit mode command 
on the tools menu has a check mark next to the com- 
mand. The edit mode command allows a user to return 
the screen editor program from the test mode. The test 
mode command switches the operation mode of the 

•to screen editor from edit mode to a test or demonstration 
mode. The test mode allows the user to test the screen 
(i.e. run the media frame and use the controls) in the 
manner intended for the end user.JTb return to the edit 
mode, the user selects the edit mode-command. A check 

•*5 mark located next to the test mode command on the tools 
menu indicates the test mode is the active mode. 

Figure 17e illustrates a help menu for the screen 
editor program configured in accordance with an embod- 
iment of the invention. The help menu contains the "help 

50 index" and "about" commands. The help index command 
is configured in accordance with the standard Win- 
dows™ help index type function. In general, the help in- 
dex function allows the user to select from a category 
index to obtain help to operate the screen editor pro- 

55 gram. An about command is implemented as a standard 
Windows rM type "about box" for a windows program. 

The present arrangement includes a screen tem- 
plate editor to provide capabilities for constructing 
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screen template definitions. The screen template defini- 
tions include defining backgrounds, borders, drop boxes, 
logos, controls, and media frame windows. Figure 20 
illustrates a GUI for the screen template editor config- 
ured in accordance with an embodiment of the invention 
In a preferred embodiment of the present invention, the 
screen template editor is implemented as a Microsoft™ 
Windows program. The screen template editor screen 
layout contains a title bar 2600. The title bar 2600 in- 
cludes a standard control/menu box 2601 . "screen tem- 
plate editor" title bar 2605, and a pair of minimize/maxi- 
mize buttons 2607. The screen template editor menu bar 
2600 provides pull down access to menu selections. For 
example, the screen template editor menu bar 2600 pro- 
vides for mouse click and accelerator key selection. 

The screen template editor screen layout also'con- 
tains a tool bar 2610 for providing commonly used func- 
tionality to the user. The tool bar 2610 includes buttons 
to pull up tool dialogs for controls, logos, background and 
borders, and media frame windows. A first button 2611 
on the tool bar 2610 allows traversal ordering of controls 
for manual assignment. A second button 26 1 2 on the tool 
bar 2610 allows for testing the controls on a screen tem- 
plate to see that a locked control user interface and pick 
access traversal occur in the correct order. For purposes 
of explanation , a locked control user interface is a user 
interface that does not use a cursor, but instead provides 
some indication to the user about the control currently 
ready for activation. Typically, a set of cursor move but- 
tons increments the particular indication from one control 
to the next. ■ 

The screen template editor screen layout contains 
a plurality of tool dialog boxes. Specifically, the screen 
layout contains a logos tool dialog box 2615. back- 
grounds and border tool dialog box 2620. a media frame 
tool dialog 2625, a controls tool dialog box 2630, and a 
screen template filled window 2635. All of the tool dialog 
boxes include a control/menu button in the upper left cor- 
ner The control/menu button is implemented from a 
standard Microsoft™ Windows function. The con- 
trol/menu button may be utilized to close a tool dialog 
box. Once a tool dialog box has been closed, the respec- 
tive box is reopened by selecting the box from the tool 
bar 2610 or from a menu selection. In the screen tem- 
plate editor, only one instance of each of the tool dialogs 
can be invoked at one time. Opening multiple instances 
of each tool dialog serves no useful purpose. 

Figure 21a illustrates a controls tool dialog box con- 
figured in accordance with an embodiment of the inven- 
tion. The controls tool dialog box 2630 contains selec- 
tions for selecting a control type mode. Typical control 
type modes include buttons, sliders and indicators. For 
the control tool dialog box illustrated in Figure 21a. the 
selections include buttons 2631. sliders 2632. and indi- 
cators 2633. The buttons mode permits a user to select 
from various types of buttons including momentary, tog- 
gle, checkbox and radio button. The sliders mode per- 
mits a user to select from controls with multiple output 



states such as volume sliders and rotational knobs. The 
indicators mode permits a user to select from various 
sorts of light emitting diode (LED) indicators such as red, 
yellow and green, circular LEDs, bargraph LEDs. semi- 
5 circle meter LEDs, and seven segment numerical read- 
out LEDs. The controls tool dialog contains a list box al- 
lowing control selection from a set of bit map images. 
The selections, located at the right hand side of controls 
tool dialog box 2630, provide the user with color, orien- 
ts tation, subtype, type and attached function selection ca- 
pabilities. 

Figure 21b illustrates a logos tool dialog box con- 
figured in accordance with an embodiment of the inven- 
tion. The logos tool dialog box 2615 allows users to se- 

is lect from sets of bit mapped corporate logos. In a pre- 
ferred embodiment, the corporate logos are prescanned 
using an image editor such as Adobe™ Photoshop. The 
corporate logos are loaded over a screen templates 
background using an icon type graphics primitive that 

20 supports a transparent surround for the logo. A list box 

261 7 provides descriptive labels for each corporate logo 
currently selectable. Also, a thumbnail sketch window 

2618 displays a picture of the highlighted logo descrip- 
tion in the list box 2617. A select button 2619 attaches 

25 the selected corporate logo to the mouse cursor so that 
the logo may be dropped into the screen template built 
window 2635. New logo description labels are added to 
the logo tool dialog by invoking a new logo dialog box 
(not shown). The new logo dialog box permits adding, 

^o deleting, previewing, and canceling of logos. In addition, 
the new dialog box permits entry of text description for 
each logo. 

Figure 21c illustrates a backgrounds and borders 
tool dialog box configured in accordance with an embod- 

35 iment of the invention. The backgrounds and borders tool 
dialog box 2620 provides users with options for control- 
ling the graphical took of the screen template. The back- 
grounds and borders tools dialog box 2620 provides the 
user with capabilities to select background color and tex- 

10 ture, border color and style, and various sorts of divider 
line and drop box shapes. A list box 2629 allows a user 
to scroll through possible selections. A thumbnail sketch 
window 2628 allows a user to view the corresponding 
highlighted selection in the list box 2629. A select button 
2627 attaches a user's selection to the cursor control de- 
vice so that the user may drop the selected item onto the 
screen template built window 2635. Ah additional dialog 
box (not shown), invoked through a menu selection, al- 
lows adding, deleting, and previewing new choices to the 

so backgrounds and borders tool dialog. 

Figure 21 d illustrates a media frame windows tool 
dialog box configured in accordance with an embodi- 
ment of the invention. The media frame windows tool di- 
alog box 2625 allows selection of a media frame window 

55 location and size within the generic screen template. The 
media f rame tool dialog box 2625 includes a list box 2631 
and a thumbnail sketch box 2632 for assigning specific 
media frames to the generic screen template. The 
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thumbnail sketch window 2632 also shows sizing of the 
media frame window. A select button 2640 permits a user 
to select a media frame from the list box 2631 . Selecting 
a media frame from the list box 2631 attaches the select- 
ed media frame to the cursor control device. In addition, 
the selected media frame appears on the output display 
with a dotted border comprising the size and aspect ratio 
of the selected media frame. To select a media from a 
for the screen template, the user places the dotted bor- 
der onto the generic screen template in the screen tem- 
plate built window 2635. and drops the dotted border into 
place by selecting a control button on the cursor control 
device. A special selection within the list box 2631 allows 
the user to retrieve a free formatted dotted border which 
can be adjusted to any size or aspect ratio. The assign 
button 2633 attaches specific media frames to the cursor 
control device for drag and drop operations into the ge- 
neric screen template on the screen template build win- 
dow 2635. 

As shown in Figure 20, the screen template build 
window 2635 provides a space for constructing a screen 
template. As described above, the various component 
elements of a screen template are attached to the mouse 
cursor and dragged and dropped into the screen tem- 
plate build window 2635. In addition selecting elements 
with the cursor control device, already positioned within 
the screen template build window, allows a user to easily 
reposition, cut. copy and paste. Editing the screen tem- 
plate build window 2635 is accomplished through the edit 
menu. Selecting, with the cursor control device, the order 
button on the tool bar 2610 places the screen template 
into the order control traversal mode. In the order control 
traversal mode, a user selects the order in which a locked 
control user interface steps from one control to the next. 

A test button 261 2. selectable from the tool bar 26 1 0. 
allows a user to test functionality attached to a particular 
control. If the user selects the test button 2612, the 
screen template editor enters the test mode. Upon invo- 
cation of the test mode, a message box is displayed. The 
message box is utilized to display a text string that indi- 
cates the nature of operations attached to controls 
through the function button within the controls tool dialog. 
As a user operates controls in a screen template, any 
attached functionality is indicated by an appropriate 
message. A build button returns the screen template 
build window 2635 to the build mode. 

When operating within the screen template editor, 
screen templates are stored into a file. The file contains 
the name of the active project and the file extension 
M STM". Any number of screen templates are stored into 
the screen template file, and are identified by screen 
template identification values. An operations/screen 
template dialog menu selection allows user access to 
screen template header information. The opera- 
tion/screen template dialog includes fields that permit a 
user to set a screen template's name, description, id and 
reference to one other screen template When a screen 
template's identification value is edited, an automatic ad- 



justment of all other preassigned identification values oc- 
curs. Consequently, each screen template identification 
is unique within a particular project. For example, chang- 
ing a screen template id to 20,- when id values of 20 - 25 
5 are already defined within a particular project, automat- 
ically bumps the preassigned ids to the range of 21 - 26. 
Screen templates are automatically assigned screen 
template identification values in ascending order begin- 
ning at 1 . 

*o The screen template editor contains a reference ca- 
pability to allow a screen template to copy common char- 
acteristics from another previously defined screen tem- 
plate, A next and previous button, contained in a first 
screen template, may be referenced by all other screen 
'5 templates within the particular project to automatically 
copy the control and logo characteristics. Specific char- 
acteristics referenced from another screen template are 
displayed within the screen template build window 2635. 
The referenced characteristics cannot be repositioned or 

20 deleted. Instead, edits are performed on the screen tem- 
plate where the controls and logos were originally de- 
fined. The screen template editor also contains a control 
order override so that controls copied from a reference 
screen template may be reordered for control traversal. 

25 The test mode for the screen template editor permits 
controls and referenced screen templates to be tested 
even though the assigned functionality cannot be al- 
tered. Instead, assigned functionality of a reference 
screen template may be altered when the original refer- 

30 ence screen template is active in the screen template 
editor. The screen template reference capability reduces 
network bandwidth in file server storage requirements by 
sharing redundant screen template definitions. 

The media frame editor provides capabilities for 

35 combining images, graphics, animations, video clips, 
text, and sound clips on a common timeline. Figures 
22a-d illustrate a GUI for the media frame editor config- 
ured in accordance with an embodiment of the invention. 
In a preferred embodiment, the media frame editor is im- 

•*o plemented as a Microsoft™ Windows program. As 
shown in Figure 22a, the screen layout for the media 
frame editor contains a title bar 2800. including a stand- 
ard control/menu box, "media frame editor" title, and min- 
imize and maximize buttons 2803. A menu bar 2805 pro- 

4 5 vides pull down access to menu selections. The menu 
bar 2805 provides for mouse click and accelerator key 
entry selection 

The tool bar 2810 includes time. line edit functions 
such as cut symbol 2811 . fade in symbol 2812. fade out 

50 2813. and dissolve 2814. The timeline edit functions are 
selected by placing the cursor control device on the func- 
tion symbol and depressing a button to select the sym- 
bol The function symbol is then dragged, with the button 
being depressed across a portion of a timeline track to 

55 generate a track edit A fade or dissolve begins when the 
mouse button is pressed, and ends when the mouse but- 
ton is released (as long as both the mouse press and 
release occur within a single track window) Also located 
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on tool bar 2810 are three screen wipe buttons 2815, 
1816. and 2817. The wipe buttons provide, for example, 
horizontal vertical and diagonal wipes between media 
elements. A wipe is a hard or soft edged fine transition 
from one media element to the next media element. The 
media frame track edit syntax diagram provides addition- 
al definitions of the on-screen edit marks. 

The tool bar 2810 also provides buttons: set break 
point 2818, clear break point 2819, and clear all 2820. 
The set break point 2818, clear break point 2819 and 
clear all 2820 set, clear, and clear all break points, re- 
spectively. With the break point functions, multiple break 
points may be set by the user. In operation, when a user 
sets a pair of break points, each successive run opera- 
tion plays the selected tracks between adjacent break 
points. If the user selects the clear break point button 
2819, the closest breakpoint to the timeline cursor is 
cleared. The clear all break point button 2820 clears all 
currently set break points. The toolbar 281 0 also displays 
information via a current time window 2821 and a maxi- 
mum time field 2822. The current time field 2821 displays 
the time position of the timeline cursor. The maximum 
time field display 2822 indicates the total media frame 
time length. Also shown on the toolbar 2810 is a compile 
button 2823. The compile button 2823 permits periodic 
saves under the currently active media frame file name. 
If no media frame file name exists, the user is prompt by 
an input dialog box so that the user may enter one. 

Figure 22b illustrates the timeline window 2825 for 
the media frame editor. The timeline window 2825 on the 
media frame editor 2800 displays up to three media 
tracks against a time scale. A vertical solid line cursor 
2826 traverses the time scale and the track window from 
left to right when a user runs a particular media frame. 
Dotted vertical lines, such as dotted vertical lines 2827 
and 2828, indicate break point time positions. A time 
units button 2829 permits a user to toggle the time scale 
units between seconds and minutes. The time units but- 
ton 2829 label changes when the button is depressed, 
toggling back and forth between "seconds" and "min- 
utes". The timeline window 2825 displays three tracks 
2830, 2832 and 2834. Each track contains a button label 
2844 for Track 1, 2846 for Track 2. and 2848*for Track 
3. 1 f a user successively presses a button label for a cor- 
responding track, the button label displays the possible 
choices indicating the current selection. 

A slide bar 2850 at the bottom of the timeline window 
2825 permits panning of the time scale and track dis- 
plays in the range from time zero up to the maximum 
time for the media frame. A pair of bump up bump down 
buttons 2851 and 2852, respectively, permits a user to 
adjust the maximum time for the media frame. The media 
frame editor utilizes standard film editing marks to rep- 
resent track cuts, fades, and dissolves. The track cuts, 
fades, and dissolves define the length of media elements 
within track window 2825. A cut is represented as a ver- 
tical line in the track, A fade in is represented as a side- 
ways "V" pointing to the left as shown at time "0 H on 



"Track 2". A fade out is represented as a sideways "V" 
pointing to the right. A dissolve between track elements 
is represented as a slanting line from bottom to top of the 
respective track. A slanting line running from the top to 

5 bottom indicates a wipe. A continuation of the current 
track elements is indicated by two horizontal lines. A 
blank space in a particular track is indicated by a single 
horizontal line in the center of the corresponding track. 
The blank space indicates silence for audio or blank 

10 screen for video. The length and position of track editing 
marks are relative to the time scale. The media frame 
track edit syntax diagram provides additional details 
about track editing marks. 

The media frame editor also contains a media se- 

15 lection window 2852, located in the lower left corner of 
the media frame editor screen display 2800. as illustrat- 
ed in Figure 22c. The media selection window 2852 al- 
lows selection of media frames for attachment to a par- 
ticular track. Within the media selection window 2852 : a 

20 plurality of buttons are provided for selecting the type of 
media element. The buttons include an image button 
2836, graphics button 2837, animation button 2838. vid- 
eo button 2839, sound button 2840 and text button 2842. 
A list box 2854 provides a selection mechanism for spe- 

25 cific media elements within the active media type, and 
the active media element is shown at the top of the list 
box 2854. A slide bar 2855 on the list box 2854 allows 
traversal of the possible media selections. f 
A thumbnail sketch window 2859 provides a means 

30 to show viewable media elements. For the example 
shown in Figure 22c. a video media element of New 
York is displayed in the thumbnail sketch window 2859. 
A play button 2857 plays the currently selected media 
element. If the media element is a sound clip, no view is 

35 shown in the thumbnail sketch window 2859, but the cor- 
responding sound clip is played on the host computer 
system sound card. A select button 2860 attaches the 
current media element to the cursor control device there- 
by permitting a user to attach a particular media element 

-to to a portion of a track. The mouse cursor changes to rep : 
resent the type of media attached (e.g. a musical note 
for sound, a rectangle for image, etc.). The mouse cursor 
is therr moved into a track window and clicked on a por- 
tion of the track for which insertion is desired. 

Figure 22d illustrates a run window for the media 
frame editor configured in accordance with an embodi- 
ment of the invention. The run window 2862 permits a 
user to play selected portions of a media frame. A mo- 
mentary run button 2864 plays the media frame between 

50 successive break points. When the run button 2864 is 
selected, the cursor traverses across the track window 
from left to right. A run view window 2866 displays view- 
able elements of the media frame, and any selected 
sound tracks are played on the computer system sound 

55 card An ail button 2868 selects all defined tracks for the 
current media frame. The buttons 2870. 2872 and 2874 
are provided for selecting/deselecting tracks 1 - 3. re- 
spectively. When the all button 2868 is asserted. Tracks 
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1 -3 buttons 2870 2872 and 2974 are automatically as- 
serted. By selecting the associated track button, any of 
Tracks 1 -3 can be deasserted. 

When multiple viewable media elements overlap in 
time, viewability priority is assigned automatically based 
on the media type. In a preferred embodiment, animation 
contains the highest viewability priority and is displayed 
over other lower priority media element layers. The text 
media contains the next highest priority layer, taking 
precedence over the remaining media elements. The 
graphics is assigned the next highest viewable priority, 
and an image has the lowest viewable priority. The video 
clips are unique because video clips are not combined 
with other viewable media image elements. An attempt 
to lay down a video track in parallel with any other view- 
able media element generates an error message. The 
media frames are stored in files containing file name ex- 
tensions of *.MFR\ 

Figure 23a illustrates a file menu for the media 
frame editor configured in accordance with an embodi- 
ment of the invention. The file menu includes a newcom- 
mand. The new command, when selected by a user : in- 
vokes a dialog box to create a new media frame. If a me- 
dia frame file is currently opened when the new com- 
mand is selected, the user is prompted to save the cur- 
rently opened media frame file prior to creating a new 
media frame file. When operating in the interactive ap- 
plications generator environment, only one media frame 
may be active at any one time. An "open" command, 
when selected by a user invokes a dialog box with a list 
box to select an existing media frame. All media frame 
files containing the file extensions MvlFR" are displayed 
in a combo box within the file open dialog. 

A "close" command, selectable from the file menu, 
closes a currently opened media frame file. If edits were 
made to the active media frame file, the user is prompted 
to save changes. A "save" menu selection, when in- 
voked, saves the currently open program. sub-program, 
or application to the associated file. The media frame file 
is saved under the name "used" when the media frame 
was loaded. If a file name for the media frame file was 
not previously specified, the user is prompted to supply 
a file name. The media frame file extension is automat- 
ically appended to a name supplied by the user. A file 
save as menu selection invokes a dialog box to save the 
current program, sub-program or application under a file 
name specified by the user The standard media frame 
file extension is automatically appended to the file name 
designated by the user 

A "print" menu selection, selectable from the file 
menu, invokes a dialog box to print the currently open 
media frame file at the current timeline cursor position. 
The user specifies an output format and number of cop- 
ies for the print operation. All selected viewable tracks 
are combined for printing, and the layers for printing are 
the same as the layers for viewing on the display screen. 
The "print setup" command, when selected, invokes a 
common dialog box to set up a printer An "exit" menu 



selection closes active media frame files. If revisions 
were made to the active open media frame file subse- 
quent to saving the file, then the user is prompted to save 
edits prior to exiting the media frame program. If the me- 
5 dia frame editor was invoked from another portion of the 
interactive applications generator program, control is re- 
turned to the calling program. 

Figure 23b illustrates an edit menu for the media 
frame editor configured in accordance with an embodi- 
10 ment of the invention. An "undo" command selection re- 
verses the most recent track edit operation performed by 
the user. A "cut" menu selection deletes the selected por- 
tions of a track. The deleted portion of the track is copied 
to the windows clip board, and is accessible to the win- 
's dow track at a future time. A "copy- menu selection cop- 
ies selected portions of a track to the windows clip board. 
A "paste" menu selection inserts the contents of the win- 
dows clip board into the track window at a point desig- 
nated by a user. The "delete" menu selection removes 
20 the currently selected portion of a track. 

Figure 23c illustrates a view menu for the media 
frame editor configured in accordance with an embodi- 
ment of the invention. A "zoom in" command, selectable 
from the view menu, permits the user to decrease the 
25 displayed time scale range down to 75% of the previous- 
ly displayed time range. The "zoom out" view menu se- 
lection allows the user to increase the time scale dis- 
played range up to 1 33% of the currently displayed time 
range. A "seconds" and "minutes" commands, selecta- 
30 ble from the view menu, permits the user to toggle be- 
tween the seconds and minutes time scale. When in- 
voked by the user the menu frame editor redraws the 
time scale with the appropriate units. In addition, the me- 
dia frame editor changes the current and maximum time 
35 windows 2821 and 2822. respectively to reflect the se- 
lection. A "track set" view menu selection allows a user 
to pull up a menu box to save the three currently selected 
tracks as either track set 1 , 2. 3 or 4. The dialog box also 
allows selection of any of the four possible track sets as 
-to the current set. 

Figure 23d illustrates an operations menu for the 
media frame editor configured in accordance with an em- 
bodiment of the invention. A "cull operations menu se- 
lection permits a user to attach a track cut edit operation 
4 5 to the cursor control device. A track cut edit operation 
provides a sharp cut from one media element to the next 
subsequent media element. Figure 24a illustrates the 
media element track cut edit syntax for a preferred em- 
bodiment of the present invention. The media element 
50 track cut edit syntax is displayed in the tool bar 2810 as 
cut symbol 2811. In a preferred embodiment, the track 
cut edit is applied to a track when the left mouse button 
is pressed and released. 

The "fade in" command, selectable from the opera- 
55 tions menu illustrated in Figure 23d. permits a user to 
attach a track fade in edit operation to the cursor control 
device. Figure 24b illustrates the media element track 
fade in edit syntax for a preferred embodiment of the 
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present invention. The fade in edit operation provides a 
gradual fade in from a blank into the media element. The 
media element track fade in edit syntax is displayed in 
the tool bar 281 0 as fade in symbol 281 2, In the preferred 
embodiment, the fade in edit operation is applied to a 
track by pressing a left button on the cursor control de- 
vice at the start of the fade in : dragging the mouse cursor 
to the end of the fade in, and releasing the mouse button. 
In order to effectively apply the edit operations to a track, 
the mouse cursor begins and ends within the same track 
window. 

A "fade out" menu selection on the operations menu 
permits a user to attach a track fade out edit operation 
to the mouse cursor. Figure 24c illustrates the media 
element track fade out edit syntax for a preferred embod- 
iment of the present invention. The fade out edit syntax 
provides a gradual fade out from a media element to a 
blank track. The media element track fade out edit syntax 
is displayed in the tool bar 281 0 as fade out symbol 281 3. 
In a preferred embodiment, the fade out edit operation 
is applied to a track by pressing the left mouse button at 
the start of the fade out, dragging the mouse cursor to 
the end of the fade out and releasing the mouse button. 
The mouse cursor begins and ends within the same track 
window to effectively execute the fade out operation. 

A "dissolve" menu selection, selectable from the op- 
erations menu, permits a user to attach a track dissolve 
edit operation to the mouse cursor. Figure 24d illus- 
trates the media element track dissolve edit syntax for a 
preferred embodiment of the present invention. The dis- 
solve track edit operation provides a gradual transition 
to mix two media elements between the transition from 
the first to the second. The media element track dissolve 
edit syntax is displayed in the tool bar 2810 as dissolve 
symbol 2814 The dissolve edit operation is applied to a 
track by pressing the left mouse button at the start of the 
dissolve, dragging the mouse cursor to the end of the 
dissolve and releasing the mouse button. The mouse 
cursor begins and ends within the same track window for 
the dissolve operation to effectively operate on a track. 

A "vertical wipe" menu selection permits a user to 
attach a track wipe edit operation to the mouse cursor. 
In a preferred embodiment. Figure 24e illustrates the 
media element track vertical wipe edit syntax from left to 
right, and Figure 24f illustrates the media element track 
vertical wipe edit syntax from right to left. The media el- 
ement track vertical wipe edit syntax is displayed in the 
tool bar 2810 as screen wipe symbol 281 5. The currently 
selected vertical wipe is applied to a track by pressing 
the left mouse button at the start of the wipe, dragging 
the mouse cursor to the end of the wipe, and releasing 
the mouse button, in order to effectively apply the wipe 
operation to a track, the mouse cursor begins and ends 
within the same track window The "vertical wipe direc- 
tion" selection on the operations menu, upon selection 
by a user, invokes a dialog box allowing the user to select 
a vertical wipe direction from right to left, or from left to 
right. 
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The "horizontal wipe" selection on the operation 
menu permits a user to attach a track wipe edit operation 
to the mouse cursor. In a preferred embodiment, Figure 
24g illustrates the media element track horizontal wipe 

5 edit syntax from top to bottom, and Figure 24h illus- 
trates the media element track horizontal wipe edit syn- 
tax from bottom to top. The media element track vertical 
wipe edit syntax is displayed in the tool bar 2810 as 
screen wipe symbol 2816. The currently selected hori- 

to zontal wipe is applied to a track by pressing the left 
mouse button at the start of the wipe, dragging the 
mouse cursor to the end of the wipe, and releasing the 
mouse button. The mouse cursor begins and ends within 
the same track window for the wipe to be applied to a 

'5 particular track. 

"* The "diagonal wipe" selection on the operation 
menu permits a user to attach a track wipe edit operation 
to the mouse cursor. In a preferred embodiment, Figure 
24i illustrates the media element track diagonal wipe edit 

20 syntax from lower left to upper right hand corner and 
Figure 24j illustrates the media element track diagonal 
wipe edit syntax from upper left to lower right corner. In 
addition, Figure 24k illustrates the media element track 
diagonal wipe edit syntax from lower right to upper left 

25 hand corner, and Figure 241 illustrates the media ele- 
ment track diagonal wipe edit syntax from upper right to 
lower left corner. The media element track vertical wipe 
edit syntax is displayed in the tool bar 2810 as screen 
wipe symbol 281 7. The currently selected diagonafwipe 

30 direction is used. The "diagonal wipe direction" selection 
on the operations menu. invokes a dialog box, when se : 
lected by a user, that allows the user to select a diagonal 
wipe direction. The diagonal wipe directions include: up- 
per right to lower left corners, lower right to upper left 

35 corners, upper left to lower right corners, and tower left 
to upper right corners. 

A "set breakpoint" menu selection on the operations 
menu, illustrated in Figure 23d, permits a user to attach 
a break point to the mouse cursor. A break point is set 

io by the user by pressing a left mouse button and releasing, 
the button within the time scale window, or within any of 
the three track windows. A "clear breakpoint" menu se : 
lection on the operations menu permits a user to clear 
the break point closest to the current cursor position. If 

^5 no break points are currently set, a message box dis- 
plays the message "no break points are currently set." 
After displaying the message box. the menu frame editor 
waits for the user to press an "OK" button. A "clear all 
breakpoints" menu selection on the operations menu 

50 permits a user to clear all currently set break points. If 
no break points are set. the media frame editor displays 
a message box containing the message, "no break 
points are currently set." In response, the user is prompt- 
ed to press an "OK" button. A "set maximum time" com- 

55 mand selectable from the operations menu invokes a di- 
alog box when selected by a user that allows the user to 
set the maximum time of the media frame. 

Figure 23e illustrates a tools menu for the media 
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frame editor configured in accordance with an embodi- 
ment of invention. An "image editor" menu selection on 
the tools menu permits a user to call the selected image 
editor. An image editor may comprise any commercially 
available multi-media editing program. A "graphics edi- s 
tor" menu selection on the tools menu calls the selected 
graphics editor when invoked by the user. The "anima- 
tion editor" menu selection on the tools menu calls an 
animation editor when selected by the user. A "video ed- 
itor" menu selection and a "sound editor" menu selec- w 
tions, selectable from the tools menu, calls a video and 
sound editor respectively. Similarly, a "text editor" menu 
selection on the tools menu calls a text editor. A "pick 
editors" menu selection on the tools menu invokes a di- 
alog box allowing selection of various media element ed- '5 
itors. In a preferred embodiment, the dialog box contains 
a set of standard industry programs commercially avail- 
able. In addition, the pick editors menu selection permits 
a user to specify a program name and search path for 
the program name. A "run selected" menu command se- 20 
lectable from the tools menu plays selected tracks of me- 
dia frames between adjacent break points. A "run all" 
menu selection, when invoked, plays all tracks of the me- 
dia frames between adjacent break points. A "compile 
media frame" menu selection, selectable from the tools 25 
menu, compiles tracks of a media frame into a menu 
frame file with the file extension ".MFR". 

Figure 23f illustrates a help menu for the media 
frame editor configured in accordance with an embodi- 
ment of the invention. A "help index" menu selection. 30 
when selected by a user, invokes a help dialog with a list 
of help entries for the media frame editor. An "about" 
menu selection on the help menu invokes an about dia- 
log box that lists the current version of the media frame 
editor and the release date. The dialog box also lists 35 
Sony Trans Com, Inc. address and ownership message. 

Figure 25 illustrates a pan display effect for the me- 
dia frame editor embodying the invention. In genera,: the 
pan display effect permits a user of the interactive appli- 
cations generator to pan media subject matter for pres- -to 
entation in the interactive presentation environment. In 
order to generate the pan display effect, the media frame 
editor provides intermediate pull points and key frames. 
For the example illustrated in Figure 25, the media sub- 
ject matter contains seven intermediate pull points and -ts 
two key frames. The key frames define a beginning 
frame and an ending frame for the pan display effect. 
The intermediate pull points define intermediate or inter- 
mittent points between the beginning and ending key 
frames. In order to completely define the pan display ef- 50 
feet, the media frame editor provides path movement 
timing. The path movement timing includes accelerator, 
velocity, and size change. The acceleration and velocity 
define the rate at which frames, representing the inter- 
mediate pull points, are displayed. For the example illus- 55 
trated in Figure 25, the cityscape is displayed in nine 
frames, beginning with the first key frame, shown in the 
left portion, and continuing to the second key frame 



shown in the right portion of the display window. The me- 
dia frame editor also includes a disable zoom, disable 
frame, a show move and play move controls. In addition, 
on the bottom portion of the media frame editor display, 
the time elapsed for the pan display effect and the 
amount of zoom are shown 

Figure 26 illustrates a zoom display effect for the 
media frame editor embodying the invention. Analogous 
to the pan display effect shown in Figure 25, the zoom 
display effect involves specifying key frames and inter- 
mediate pull points. For the example illustrated in Figure 
26. two key frames and seven intermediate pull points 
are defined. The first key frame focuses on the center 
two balloons and the zoom display effect opens up to 
shown all five hot air balloons. The zoom display effect 
of the present arrangement provides, a user with the 
zoom rectangle timing by graphing the acceleration , ve- 
locity, and size change as the media frames zoom from 
the first key frame to the second key frame. 

Figure 27 illustrates a first complex pan and zoom 
effect for the media frame editor embodying the inven- 
tion. For the first complex pan and zoom effect illustrated 
in Figure 27, four key frames are specified. The first key 
frame, showing the torch of the Statue of Liberty, and the 
second key frame shows the upper portion of the statue. 
The third key frame shows most of the statue, and the 
fourth key frame shows the entire media frame available. 
Consequently, the resulting media frames both pan and 
zoom the Statue of Liberty and the New York city back- 
ground. For the complex pan and zoom effect, the media 
frame editor provides zoom rectangle image and path 
movement timing information. The key frames are des- 
ignated by an oval on the timeline, and the intermediate 
pull points are designated by a square. For the complex 
pan and zoom effect illustrated in Figure 27. four inter- 
mediate pull points are designated. As discussed above, 
the zoom rectangle image and path movement timing 
show the acceleration, velocity and size change for the 
respective display effect. 

Figure 28 illustrates a second complex pan and 
zoom effect for the media frame editor embodying the 
invention. The second complex pan and zoom effect in- 
cludes two key frames. As shown in the display window, 
the first key frame shows a portion oNhe hot air balloon 
in the foreground, and the second key frame includes the 
entire media frame subject matter. For the second com- 
plex pan and zoom effect illustrated in Figure 28, five 
intermediate pull points are specified. Consequently, in 
seven frames, the media frame editor scans the media 
frame subject matter from the first key frame to the sec- 
ond key frame. As described above, the media frame ed- 
itor provides zoom rectangle image and path movement 
liming. 

Figures 29a-f illustrate a target application media 
frame format configured in accordance with an embodi- 
ment of the invention. As shown in Figure 29a. the me- 
dia frame format includes a media frame id. media frame 
size, and media types count. The media types count 
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specifies a length for the various multimedia types. Spe- 
cifically, the media frame format contains a sound offset, 
image offset, graphics offset, animation offset, and video 
offset fields. Figure 29b illustrates the sound offset field 
containing a sound item count field. In addition, for each 
sound item, the sound offset field contains a sound item 
type.sound item offset, sound item size, and sound item 
time fields. The sound item offset field specifies an ad- 
dress for the corresponding sound item data. Figure 
29c illustrates the image offset field. The image offset 
field specifies an image item count to specify the length 
of the image item fields. For each image item, a type, 
offset, size and time fields are specified. The offset field 
specifies the starting location for the corresponding im- 
age item data. Similarly, the graphics;, animation, and 
video multimedia types are specified as shown in Fig- 
ures 29d, 29e, and 29f, respectively. 

Figure 30 illustrates a generalized output format for 
the interactive applications generator embodying the in- 
vention. In a preferred embodiment, the interactive ap- 
plications generator stores an intermediate data format 
generated by each of the primary component parts. The 
output data format is optimized for modification and flex- 
ible editing. In addition to the primary components de- 
scribed above, the present invention operates in con- 
junction with an output program generator. The output 
program generator creates file server and user portions 
of. code and media descriptions for a particular interac- 
tive presentation environment. The output format is ap- 
plication specific, and therefore varies, depending upon 
the target interactive application environment. As is well 
known in the art, multiple target output formats may be 
created from a single intermediate output format. Typi- 
cally, the target output formats are optimized for perform- 
ance and size. For example, target output formats may 
be compatible with Microsoft® modular windows. Kalei- 
da's Script X, or other typical multimedia scripting or 
graphical user interface languages. In addition, as one 
skilled in the art will appreciate, other application specific 
formats may be generated from the intermediate format 
disclosed herein. 

An interactive applications generator„embodying the 
invention may be implemented with software to perform 
the functions of the. screen template editor, the media 
frame editor, the screen editor, and the interactive pres- 
entation editor. In one embodiment, the interactive appli- 
cations generator is implemented with object-oriented 
computer programs. Figures 31a-b illustrate, in Booch 
notation, one implementation for the interactive applica- 
tions generator. However, any programming language 
may be used to implement the interactive applications 
generator without deviating from the scope of the inven- 
tion. 

Although the present invention has been described 
in terms of a preferred embodiment, it will be appreciated 
that various modifications and alterations might be made 
by those skilled in the art without departing from the 
scope of the invention. The invention should therefore 



be measured in terms of the claims which follow. 



Claims 

5 

1. An apparatus for generating an interactive applica- 
tions environment, said apparatus comprising: 

a screen template editor for creating generic 
screen templates comprising a plurality of generic 
10 screen template elements: 

a media frame editor for generating media 
frames by combining multimedia component ele- 
ments in a time synchronized manner: 
r a screen editor for generating display screens, 

15 . : i including assigning functionality to said display 
screens, for use in said interactive applications envi- 
ronment, said screen editor being constructed to ref- 
erence generic screen templates and media frames 
to create a unique instance for each display screen 
20 jn said interactive applications environment: and 

an interactive presentation editor for creating 
hierarchical structures for presentation of said dis- 
play screens, wherein said hierarchical structure 
defines presentation of said display screens in said 
25 interactive presentation environment. 

2. The apparatus for generating an interactive applica- 
tions environment as claimed in claim^i v wherein 
said screen template editor comprises a screen tem- 

30 plate editor graphical user interface (GUI) for dis- 
playing a plurality of tool dialog boxes' to permit a 
user to select said plurality of generic screen tem- 
plate elements, and for displaying a screen template 
built window for designing said screen template 

35 ... .. f-r - - - 

3. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 2. wherein 
said plurality of tool dialog boxes within said screen 
template editor GUI comprise a logos dialog box, a 

-*o backgrounds and borders dialog box, controls dialog 
box and media frame window dialog box. 

4; The apparatus for generating an interactive applica- : 
tions environment as claimed in claim 3/ wherein 
~i5 said controls dialog box on said screen template edi- 
tor GUI permits selection of buttons, sliders arid indi- 
cators. 

5. The apparatus for generating an interactive applica- 
so tions environment as claimed in claim -4, wherein 

said buttons comprise momentary, toggle, checkbox 
and radio button. 

6. The apparatus for generating an interactive applica- 
55 tions environment as claimed in claim 4, wherein 

said sliders comprise volume sliders and rotational 
knobs. 
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7. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 4. wherein 
said indicators comprise red light emitting diode 
(LED) indicators, yellow (LED) indicators, green 
(LED) indicators, circular LEDs, bargraph LEDs, 5 
semicircle meter LEDs, and seven segment numer- 
ical readout LEDs . 

8. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 3 t wherein to 
said background and borders dialog box on said 
screen template editor GUI comprises a list box. for 
providing options to define a graphical look of said 
screen template, and a thumbnail sketch window for 
displaying a corresponding highlighted selection in '5 
said list box. and a select button to permit a user to 
specify background color, background texture, bor- 
der color, border style, drop boxes and lines. 

9. The apparatus for generating an interactive applica- 20 
tions environment as claimed in claim 3, wherein 
said logos dialog box on said screen template editor 
GUI comprises a list box, for listing a plurality of 
logos currently selectable, a thumbnail sketch win- 
dow for displaying a picture of a highlighted logo in 25 
said list box, and a select button to permit a user to 
select from said plurality of logos. 

1 0. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 3, wherein 00 
said media frame windows dialog box on said screen 
template editor GUI comprises a list box, for listing 

a plurality of media frames currently selectable, a 
thumbnail sketch window for illustrating specific 
media frames, including sizing, of a media frame 35 
highlighted in said list box T and a select button to per- 
mit a user to select a media frame window location 
within the generic screen template, such that a dot- 
ted border comprising size and aspect ratio of said 
media frame selected is displayed in said screen -*o 
template built window. 

1 1 . The apparatus for generating an interactive applica- 
tions environment as claimed in claim 1. wherein 
said media frames generated by said media frame 
editor comprises images, graphics, animations, 
video clips, text, and sound clips. 

1 2. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 1 . wherein so 
said media frame editor comprises a media frame 
editor graphical user interface (GUI) for displaying a 
timeline window comprising a plurality of media 
tracks, a time scale and a vertical cursor. 

55 

1 3. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 12. wherein 
said media frame editor GUI further comprises a plu- 



124 A1 




rality of time line edit functions including a cut. fade 
in. fade out. dissolve, horizontal wipe, vertical wipe, 
and digital wipe. 

1 4. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 12. wherein 
said media frame editor GUI further comprises a 
slide bar within said timeline window to permit a user 
to pan the time scale and media tracks. 

1 5. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 12, wherein 
said media frame editor GUI further comprises a 
media selection window, including a list box and a 
plurality of buttons, to permit a user to attach media 
frames to one of said plurality-of media tracks. 

1 6. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 15, wherein 
said media selection window comprises a thumbnail 
sketch window for displaying viewable media ele- 
ments selected via said list box. 

1 7. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 12. wherein 
said media frame editor GUI further comprises a run 
operation and a run window to permit a user to view 
selected media frames. 

1 8. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 17, wherein 
said media frame editor GUI further comprises a plu- 
rality of breakpoints to play successive media 
frames on a selected media track between adjacent 
breakpoints on said run window. 

1 9. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 12, wherein 
said media frame editor GUI further comprises a pan 
function to generate a series of media frames that 
pans across a media element. 

20. The apparatus for generating an interactive applica- 
tions environment as claimed-in claim 12, wherein 
said media frame editor GUI further comprises a 
zoom function to generate a series of media frames 
that zooms in and out of a media element. 

2 1 . The apparatus for generating an interactive applica- 
tions environment as claimed in claim 12, wherein 
said media frame editor GUI further comprises a pan 
and zoom function to generate a series of media 
frames that zooms in and out and pans across a 
media element. 

22. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 1 . wherein 
said display screens comprise menu screens and 
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application screens, said menu screens being con- 
structed to permit selection of another menu screen 
or an application screen, and said application screen 
comprising a graphical user interface (GUI) for a par-_ 
ticular application program operating within said s 
interactive presentation environment. 

23. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 1 : wherein 
said screen editor comprises a screen editor graph- 10 
ical user interface (GUI) for displaying a screen lay- 
out including , a graphical representation of said 
generic screen template referenced comprising 
media frame windows and controls. 

24. The apparatus for generating an interactive applica- ^ 
tions environment as claimed in claim 1 , wherein 
said screen editor further comprises a media frame 
catalogue comprising a separate window and being 
constructed to permit a user to scroll through a cat- 20 

■ alogue of media frames so as to assign, via a drag 
and drop operation, a media frame to a media frame 
area on said screen layout. 

25. The apparatus for generating an interactive applica- 25 
11 tions environment as claimed in claim 1, wherein 

said screen editor further comprises a function 
library catalog comprising a separate window and 
being constructed to permit a user to scroll through 
4 a library of predefined functions so as to assign, via so 
a drag and drop operation, a specific function to a 
control on said screen layout. 

26. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 1, wherein 35 
said interactive presentation editor comprises an 

■* interactive presentation editor graphical user inter- 
face (GUI) comprising a plurality of screen identifier 
* icons displayed on an output display, wherein said 
plurality of screen identifiers correspond to a plural- -*o 
ity of display screens, said interactive presentation 
editor GUI being constructed to permit placement of 
said plurality of screen identifiers in a hierarchical * 
structure. " v ~ 

' ' ' ' ' 45 

27. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 26, wherein 
said interactive presentation editor graphical user 
interface (GUI) comprises a plurality of dialog boxes 
corresponding to said plurality of display screen to so 
permit entry of specific display screen information 
such as text description of a corresponding display 
screen, linking said corresponding display screen to 

a media frame and a screen template, a list of each 
control on said corresponding display screen, and a 55 
link to either an application screen or menu screen 

28. The apparatus for generating an interactive applica- 
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lions environment as claimed in claim 27. wherein 
said specific display screen information entered 
through said plurality of dialog boxes further com- 
prises grouping information to permit group level 
classification of display screens. 

29. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 26, wherein 
said interactive presentation editor GUI comprises: 

a menu screen operation to add a new menu 
screen to said hierarchical structure, said menu 
screen operation being a drag and drop type oper- 
ation permitting placement of a corresponding 
screen identifier representing a menu screen 
selected, in any level of said hierarchical structure; 
and - 

an application screen operation to add a new 
application screen to said hierarchical structure, 
said application screen operation being a drag and 
drop type operation permitting placement of a 
screen identifier, representing a application screen 
selected, in any level of said hierarchical structure. 

30. The apparatus for generating an interactive applica- 
tions environment as claimed in ciaim'29 : wherein 
said menu screen, operation and said application 
screen operation comprises an automatic forward 
fink to create a forward fink from a parent menu 
screen to said selected menu screen and application 
screen, said automatic forward link operation being 
invoked upon placement of said screen" identifier 
over a parent menu screen identifier to" establish a 
forward link from said parent screen to said menu 
screen or said application screen selected. 

31 . The apparatus for generating an interactive applica- 
tions environment as claimed in claim 29, wherein 
said application screen operation comprises an 
application group function to permit grouping of par- 
ticular application screens, said interactive presen- 
tation editor GUI being constructed to display said 
application screens in a horizontal direction to define 
an order for presentation of said application screens 
in said interactive presentation environment 

32. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 26, wherein 
said interactive presentation editor GUI further com- 
prises a screen catalog comprising a window and 
being constructed to permit a user to scroll through 
a library of display screens so as to select a display 
screen for placement in said interactive applications 
environment. 

33. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 26, wherein 
said interactive presentation editor GUI further.com- 
prises a forward path command to establish a link 
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from a control in a parent menu screen to a child 
display screen. 

34. The apparatus for generating an interactive applica- 
tions environment as claimed in claim 26, wherein s 
said interactive presentation editor GUI comprises 

a back path command to establish link from a child 
display screen to exit to a screen other than a cor- 
responding parent screen. 

w 

35. A method for generating an interactive applications 
environment, said method comprising the steps of: 

providing a plurality of multimedia component 
elements: 

generating at least one generic screen tern- is 
plate comprising a plurality of generic screen tem- 
plate elements: 

generating media frames by combining said 
multimedia component elements in a time synchro- 
nized manner: 20 

generating display screens for use in said 
interactive applications environment, by referencing 
said generic screen templates and said media 
frames to create a unique instance for each display 
screen in said interactive applications environment; 25 

assigning functionality to said display screens: 

and 

generating hierarchical structures for presen- 
tation of said display screens, wherein said hierar- 
chical structure defines presentation of said display 00 
screens in said interactive presentation environ- 
ment. 

36. The method as set forth in claim 35, wherein the step 

of generating at least one generic screen template 35 
comprises the steps of: 

displaying a plurality of tool dialog boxes to 
permit a user to select said plurality of generic 
screen template elements: and 

displaying a screen template built window for -10 
designing said screen template. 

37. The method as set forth in claim 36 ; wherein the step 
of displaying a plurality of tool dialog boxes com- 
prises the steps of: 4S 

displaying a logos dialog box: 

displaying a background and borders dialog 

box: 

displaying controls dialog box: and 

displaying a media frame window dialog box. so 

38. The method as set forth in claim 37. wherein the step 
of displaying a background and borders dialog box 
comprises the steps of: 

displaying a list box that provides options to ss 
define a graphical look of said screen template: 

generating a thumbnail sketch window that 
displays a corresponding highlighted selection in 
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said list box. and 

displaying a select button to permit a user to 
specify background color, background texture, bor- 
der color border style, drop boxes and lines. 

39. The method as set forth in claim 37. wherein the step 
of displaying a logos dialog box comprises the steps 
of: 

displaying a plurality of currently selectable 
logos: 

displaying a thumbnail sketch window that dis- 
plays a picture of a highlighted logo in said list box: 
and 

generating a select button to permit a user to 
select from said plurality of logos. 

40. The method as set forth in claim 37, wherein the step 
of displaying a media frame window dialog box com- 
prises the steps of: 

displaying a list box of a plurality of media 
frames currently selectable: 

displaying a thumbnail sketch window for illus- 
trating specific media frames, including sizing, of a 
media frame highlighted in said list box: 

generating a select button to permit a user to 
select a media frame window location within the 
generic screen template: and 

displaying a dotted border comprising size and 
aspect ratio of said media frame selected. 

41 . The method as set forth in claim 35, wherein the step 
of providing a plurality of multimedia component ele- 
ments comprises the step of providing images, 
graphics, animations, video clips, text, and sound 
clips. 

42. The method as set forth in claim 35, wherein the step 
of generating media frames comprises the step of 
generating a timeline window comprising a plurality 
of media tracks, a time scale and a vertical cursor. 

43. The method as set forth in claim 42. wherein the step 
of generating a timeline window.pomp rises the step 
of generating a plurality of time, line edit functions 
including a cut. fade in. fade out. dissolve, horizontal 
wipe, vertical wipe, and digital wipe. 

44. The method as set forth in claim 42. wherein the step 
of generating a timeline window comprises the step 
of generating a slide bar within said timeline window 
to permit a user to pan the time scale and media 
tracks. 

45. The method as set forth in claim 42. wherein the step 
of generating a timeline window comprises the step 
of generating a media selection window, including a 
list box and a plurality of buttons, to permit a user to 
attach media frames to one of said plurality of media 
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tracks. 

46. The method as set forth in claim 45 : wherein the step 
of generating a media selection window comprises 
the step of generating a thumbnail sketch window 
for displaying viewable media elements selected via 
said list box. 

47. The method as set forth in claim 42, wherein the step 
of generating a timeline window comprises the step 
of generating a run operation and a run window to 
permit a user to view selected media frames. 

48. The method as set forth in claim 47 : wherein the step 
of generating a timeline window comprises the step 
of generating a plurality of breakpoints to play suc- 
cessive media frames on a selected media track 
between adjacent breakpoints on said run window. 

49. The method as set forth in claim 42. wherein the step 
of generating a timeline window comprises the step 
of generating a pan function to generate a series of 
media frames that pans across a media element. 

50. The method as set forth in claim 42, wherein the step 
of generating a timeline window comprises the step 
of generating a zoom function to generate a series 
of media frames that zooms in and out of a media 
element. 

51. 'The method as set forth in claim 42 ; wherein the step 
of generating a timeline window comprises the step 
of generating a pan and zoom function to generate 
a series of media frames that zooms in and out and 
pans across a media element. 

52. The method as set forth in claim 35, wherein the step 
of generating display screens comprises the steps 
of: ' 

displaying menu screens to permit selection of 
another menu screen or an application screen; and 

generating application screens to provide a 
graphical user interlace (GUI')"for a particular appli- 
cation program operating within said interactive 
presentation environment. 

53. The method as set forth in claim 35, wherein the step 
of generating display screens comprises the step of 
displaying a screen layout including a graphical rep- 
resentation of said generic screen template refer- 
enced comprising media frame windows and con- 
trols. 

54. The method as set forth in claim 35 ; wherein the step 
of generating display screens comprises the step of 
generating a media frame catalogue comprising a 
separate window to permit a user to scroll through 
a catalogue of media frames so as to assign, via a 
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drag and drop operation, a media frame to a media 
frame area on said screen layout. 

55. The method as set forth in claim 35. wherein the step 
s of generating display screens comprises the step of 

generating a function library catalog comprising a 
separate window to permit a user to scroll through 
a library of predefined functions so as to assign, via 
a drag and drop operation, a specific function to a 
JO control on said screen layout. 

56. The method as set forth in claim 35 ; wherein the step 
of generating hierarchical structures comprises the 
step of generating a plurality of screen identifier 

: '5 icons on an output display, wherein said screen 
identifiers correspond to said display screens to per- 
mit placement of said plurality of screen identifiers 
in said hierarchical structure. 

20 57, The method as set forth in claim 56, wherein the step 
of generating a plurality of screen identifier icons 
comprises the steps of: 

displaying a plurality of dialog boxes corre- 
sponding to said display screens to permit entry of 

25 specific display screen information including text 
description of a corresponding display screen: 

permitting a user to link said corresponding 
display screen to a media frame and a sere en tem- 
plate: 

30 displaying a list of each control on said corre- 

sponding display screen: and 

permitting a user to link said control to either 
an application screen or menu screen. 

35 58. The method as set forth in claim 57. further compris- 
ing the step of permitting a user to group information 
to classify group levels of display screens. 

59. The method as set forth in claim 56. wherein the step 
-w of generating a plurality of screen identifier icons on 

an output display comprises the steps of: 

generating a menu screen operation to add a 
new menu screen to said hierarchical structure, said' 
menu screen operation being a drag and drop type 
operation permitting placement of a corresponding 
screen identifier representing a menu screen 
selected, in any level of said hierarchical structure: 
and . 

generating an application screen operation to 

50 add a new application screen to said hierarchical 
structure, said application screen operation being a 
drag and drop type operation permitting placement 
of a screen identifier, representing a application 
screen selected, in any level of said hierarchical 

55 structure 

60. The method as set (orth in claim 59. wherein the 
steps of generating a menu screen operation and 
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generating an application screen operation com- 
prises the steps of 

generating an automatic forward link to create 
a forward link from a parent menu screen to said 
selected menu screen and application screen: and 5 

invoking, upon placement of said screen iden- 
tifier over a parent menu screen identifier, said auto- 
matic forward link operation to establish a forward 
link from said parent screen to said menu screen or 
said application screen selected. w 

61 . The method as set forth in claim 59 f wherein the step 
of generating an application screen operation com- 
prises the steps of: 

generating an application group function to '5 
permit grouping of particular application screens: 
and 

displaying said application screens, based on 
said application group function, in a horizontal direc- 
tion to define an order for presentation of said appli- 20 
cation screens in said interactive presentation envi- 
ronment. 

62. The method as set forth in claim 56, wherein the step 

of generating hierarchical structures comprises the 25 
steps of: 

generating a screen catalog comprising a win- 
dow and a library of display screens: and 

permitting a user to scroll through said library 
of display screens so as to select a display screen 30 
for placement in said interactive applications envi- 
ronment. 

63. The method as set forth in claim 56. wherein the step 

of generating hierarchical structures further com- 35 
prises the step of generating a forward path com- 
mand to establish a link from a control in a parent 
menu screen to a child display screen. 

64. The method as set forth in claim 56, wherein the step -to 
of generating hierarchical structures further com- 
prises the step of generating a back path command 

to establish a link from a child display screen to exit 
to a screen other than a corresponding parent 
screen. 45 
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